00000001:02000400:3.0F:1784403073.305143:0:3096:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_hostid 00000001:02000400:3.0:1784403091.518857:0:3417:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1784403093.658836:0:3475:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 519 MB/s 00000001:01000000:3.0:1784403093.909403:0:3475:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 875 MB/s 00000001:01000000:3.0:1784403094.159387:0:3475:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4311 MB/s 00000020:02000000:1.0F:1784403095.059862:0:3522:0:(class_obd.c:729:obdclass_init()) Lustre: Build Version: 2.17.54_174_g53e1600 00000400:02000000:2.0F:1784403096.222456:0:3543:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.204.128@tcp [8/256/0/180] 00008000:02000000:3.0:1784403099.982763:0:3716:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1784403153.491000:0:5734:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1784403163.866232:0:6272:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784403163.866242:0:6272:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1784403163.866416:0:6272:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000ffa805f0 00000080:02000400:3.0:1784403163.866432:0:6272:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1784403163.871806:0:6272:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1784403163.871827:0:6272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784403163.872192:0:6272:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002180241a) 00000020:00000080:3.0:1784403163.872225:0:6272:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1784403163.893462:0:6272:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784403163.894330:0:6272:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1784403163.927096:0:6272:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784403163.927161:0:6272:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784403163.927189:0:6272:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784403163.927249:0:6272:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784403163.927356:0:6272:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784403163.928398:0:6272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784403163.928411:0:6272:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784403163.928428:0:6272:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afa3a9 00000020:01000004:3.0:1784403163.928440:0:6272:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784403163.928446:0:6272:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784403163.928452:0:6272:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ffa805f0 from MGS 00000020:01000004:3.0:1784403163.928458:0:6272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784403163.928473:0:6272:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003a73ae82) 00000020:00000080:3.0:1784403163.928486:0:6272:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784403163.928647:0:6272:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ffa805f0 from MGS, refs=2 00080000:01000000:3.0:1784403163.928653:0:6272:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784403163.928658:0:6272:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afa3b7 00000100:00100000:3.0:1784403163.928798:0:6272:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784403163.933353:0:6272:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784403163.933369:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1784403163.937701:0:6272:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1784403163.937720:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784403163.945136:0:6272:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784403163.945829:0:6272:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784403163.945839:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784403163.947126:0:6272:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784403163.947142:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784403163.947565:0:6272:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1784403163.947573:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1784403163.952601:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403163.952610:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403163.952613:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403163.953050:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403163.953053:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403163.953055:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403163.954163:0:6272:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1784403163.967414:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784403164.204714:0:6272:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2159 MB/s 00000001:01000000:3.0:1784403164.456489:0:6272:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2519 MB/s 00000001:01000000:3.0:1784403164.706238:0:6272:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 527 MB/s 00000001:01000000:2.0:1784403164.956429:0:6272:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 607 MB/s 00080000:10000000:2.0:1784403164.978422:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1784403165.015370:0:6272:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1784403165.015395:0:6272:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784403165.015399:0:6272:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1784403165.023554:0:6283:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784403165.023709:0:6272:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784403165.023800:0:6272:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784403165.024169:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784403165.024205:0:6272:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784403165.024708:0:6272:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784403165.024953:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784403165.024961:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:3.0:1784403165.025480:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403165.034826:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784403165.034848:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784403165.039826:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784403165.039852:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784403165.041382:0:6272:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784403165.041414:0:6272:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.128@tcp' 00000020:01000004:3.0:1784403165.041416:0:6272:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784403165.041503:0:6272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.128@tcp (typ=mgc) 00000020:00000080:3.0:1784403165.041519:0:6272:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.128@tcp (00000000068ddbc9) 00000020:00000080:3.0:1784403165.041543:0:6272:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784403165.041648:0:6272:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000052abb717@MGC192.168.204.128@tcp: add connection 192.168.204.128@tcp at head 00010000:00010000:3.0:1784403165.041839:0:6272:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.128@tcp-0 is initialized 00000040:01000000:3.0:1784403165.041848:0:6272:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 1 is initialized 00000100:00080000:0.0:1784403165.042071:0:6288:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1784403165.052570:0:6290:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784403165.055563:0:6272:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.128@tcp (uuid 64472369-fee1-4bb4-a407-7797860a37a0) 00000020:00000080:1.0:1784403165.055602:0:6272:0:(genops.c:1385:class_connect()) connect: client 64472369-fee1-4bb4-a407-7797860a37a0, cookie 0x6828175665afa3c5 00000100:00080000:1.0:1784403165.055619:0:6272:0:(import.c:510:import_select_connection()) MGC192.168.204.128@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784403165.055627:0:6272:0:(import.c:624:import_select_connection()) MGC192.168.204.128@tcp: import 0000000052abb717 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1784403165.055692:0:6272:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004863201c x1871082260791424/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784403165.055730:0:6272:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 64472369-fee1-4bb4-a407-7797860a37a0->MGS 00000020:01000004:1.0:1784403165.055765:0:6272:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784403165.055771:0:6272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784403165.055794:0:6272:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000733f45de) 00000020:00000080:1.0:1784403165.055814:0:6272:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784403165.059996:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004863201c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64472369-fee1-4bb4-a407-7797860a37a0:3564:1871082260791424:0@lo:250: 00000100:00100000:2.0:1784403165.060153:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403165.060260:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260791424 00000100:00100000:2.0:1784403165.060271:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260791424 00000100:00100000:2.0:1784403165.060328:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403165.060337:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051320cc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3564:x1871082260791424:12345-0@lo:250: 00010000:00080000:2.0:1784403165.060372:0:6285:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 64472369-fee1-4bb4-a407-7797860a37a0@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:2.0:1784403165.060410:0:6285:0:(genops.c:1385:class_connect()) connect: client 64472369-fee1-4bb4-a407-7797860a37a0, cookie 0x6828175665afa3d3 00000100:00080000:2.0:1784403165.060570:0:6285:0:(import.c:65:import_set_state_nolock()) 000000004415fcae : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784403165.060637:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051320cc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+5:3564:x1871082260791424:12345-0@lo:250: Request processed in 299us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403165.060646:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403165.060697:0:3564:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.128@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784403165.060708:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.128@tcp: connect to target with instance 0 00000100:00080000:2.0:1784403165.060716:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.128@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784403165.060721:0:3564:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784403165.060724:0:3564:0:(import.c:65:import_set_state_nolock()) 0000000052abb717 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784403165.060727:0:3564:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784403165.060735:0:3564:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784403165.060739:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004863201c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64472369-fee1-4bb4-a407-7797860a37a0:3564:1871082260791424:0@lo:250: 00000100:00100000:1.0:1784403165.090810:0:6272:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784403165.093763:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784403165.093772:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784403165.097121:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784403165.097143:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1784403165.097584:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784403165.097592:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1784403165.099932:0:6272:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784403165.101192:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1784403165.101201:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1784403165.110359:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784403165.110387:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784403165.228765:0:6272:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784403165.228997:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784403165.229003:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1784403165.236972:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1784403165.236988:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784403165.241967:0:6272:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784403165.242276:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784403165.242284:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1784403165.245429:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784403165.245451:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784403165.247006:0:6272:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784403165.247465:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784403165.247472:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1784403165.255737:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784403165.255753:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784403165.256683:0:6272:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784403165.256851:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784403165.256856:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1784403165.262384:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784403165.262406:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1784403165.332733:0:6272:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784403165.333675:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784403165.333687:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784403165.355641:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784403165.355660:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784403165.357430:0:6272:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784403165.357446:0:6272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784403165.362010:0:6272:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784403165.362044:0:6272:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1784403165.362051:0:6272:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784403165.362210:0:6272:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784403165.362252:0:6272:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.128@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1784403165.362257:0:6272:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784403165.362259:0:6272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784403165.362260:0:6272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784403165.362261:0:6272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784403165.362262:0:6272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784403165.362264:0:6272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784403165.362265:0:6272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784403165.362267:0:6272:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784403165.362268:0:6272:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784403165.362269:0:6272:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784403165.362271:0:6272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784403165.362272:0:6272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784403165.362275:0:6272:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1784403165.362277:0:6272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784403165.362278:0:6272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784403165.362279:0:6272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784403165.362280:0:6272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784403165.362281:0:6272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784403165.362282:0:6272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784403165.362296:0:6272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784403165.362297:0:6272:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784403165.362297:0:6272:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784403165.362298:0:6272:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784403165.362299:0:6272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784403165.362300:0:6272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784403165.362345:0:6272:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784403165.362366:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260791552:0@lo:253: 00000100:00100000:3.0:1784403165.362461:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403165.362527:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 000000008297ac34 going to sleep for 11 seconds 00000100:00100000:0.0:1784403165.362616:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260791552 00000100:00100000:0.0:1784403165.362625:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260791552 00000100:00100000:0.0:1784403165.362687:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403165.362696:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000920993eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+5:6272:x1871082260791552:12345-0@lo:253: 20000000:01000000:0.0:1784403165.362754:0:6287:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784403165.362757:0:6287:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1784403165.364505:0:6308:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784403165.364576:0:6287:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1784403165.368474:0:6287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784403165.373035:0:6309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1784403165.373467:0:6287:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784403165.373472:0:6287:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1784403165.373493:0:6287:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1784403165.373496:0:6287:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1784403165.373515:0:6287:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1784403165.373773:0:6287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784403165.374058:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1784403165.374071:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784403165.374129:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1784403165.374182:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1784403165.374219:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1784403165.374324:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1784403165.374333:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1784403165.374391:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1784403165.374400:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1784403165.374436:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1784403165.374443:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1784403165.374472:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1784403165.374540:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1784403165.374571:0:6287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1784403165.374576:0:6287:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1784403165.374591:0:6287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784403165.374792:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1784403165.374802:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784403165.374834:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1784403165.374900:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1784403165.374957:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1784403165.374969:0:6287:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1784403165.375034:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1784403165.375043:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1784403165.375089:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1784403165.375126:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1784403165.375160:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1784403165.375170:0:6287:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1784403165.375270:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1784403165.375280:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1784403165.375312:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1784403165.375345:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1784403165.375519:0:6287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1784403165.375568:0:6287:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1784403165.375575:0:6287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1784403165.381350:0:6310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1784403165.381773:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1784403165.381807:0:6287:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.128@tcp for mdt 20000000:01000000:1.0:1784403165.381809:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:1.0:1784403165.381848:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1784403165.381857:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784403165.381939:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1784403165.381947:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:1.0:1784403165.381997:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1784403165.382009:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1784403165.382044:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1784403165.382083:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1784403165.382153:0:6287:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784403165.382157:0:6287:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784403165.382161:0:6287:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784403165.382174:0:6287:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784403165.382178:0:6287:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784403165.382209:0:6287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784403165.382211:0:6287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784403165.382997:0:6311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1784403165.383319:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1784403165.383364:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1784403165.383398:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1784403165.383412:0:6287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784403165.383414:0:6287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1784403165.383795:0:6312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1784403165.384068:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1784403165.384107:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1784403165.384166:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1784403165.384180:0:6287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784403165.384183:0:6287:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1784403165.384188:0:6287:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784403165.384190:0:6287:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784403165.384196:0:6287:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1784403165.384203:0:6287:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1784403165.400256:0:6313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1784403165.400526:0:6287:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1784403165.415251:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1784403165.415327:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1784403165.415539:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1784403165.415565:0:6287:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784403165.416523:0:6287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.416547:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.416558:0:6287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.416565:0:6287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.416571:0:6287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.417070:0:6287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.417077:0:6287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009508109c already unused, calling callback (0000000034a0205c) 00010000:00010000:2.0:1784403165.417081:0:6287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.417089:0:6287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.417103:0:6287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.417110:0:6287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.417130:0:6287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009508109c/0x6828175665afa3da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784403165.417151:0:6287:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784403165.751161:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000920993eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+5:6272:x1871082260791552:12345-0@lo:253: Request processed in 388456us (388690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403165.751180:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784403165.751318:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260791552:0@lo:253: 10000000:01000000:3.0:1784403165.751335:0:6272:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784403165.751338:0:6272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784403165.751340:0:6272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784403165.751342:0:6272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784403165.751343:0:6272:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1784403165.751344:0:6272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784403165.751346:0:6272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784403165.751347:0:6272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784403165.751348:0:6272:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784403165.751350:0:6272:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784403165.751351:0:6272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784403165.751353:0:6272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784403165.751373:0:6272:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ffa805f0 from lustre-MDT0000 10000000:01000000:3.0:1784403165.751404:0:6272:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784403165.751407:0:6272:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784403165.751412:0:6272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c8a526f8000 10000000:01000000:3.0:1784403165.751416:0:6272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784403165.751425:0:6272:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c8a526f8000 from 1 10000000:01000000:3.0:1784403165.751428:0:6272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784403165.751468:0:6272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 0000000072ecf35a/0x6828175665afa3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.751479:0:6272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 0000000072ecf35a/0x6828175665afa3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.751488:0:6272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 0000000072ecf35a/0x6828175665afa3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403165.751507:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260791680:0@lo:101: 00000100:00100000:3.0:1784403165.751560:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403165.751741:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260791680 00000100:00100000:0.0:1784403165.751748:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260791680 00000100:00100000:0.0:1784403165.751809:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784403165.751818:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d2ebf90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+5:6272:x1871082260791680:12345-0@lo:101: 00010000:00010000:0.0:1784403165.751833:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403165.751847:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001934f36a/0x6828175665afa3e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa3e1 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403165.751906:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001934f36a/0x6828175665afa3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa3e1 expref: 6 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403165.751917:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001934f36a/0x6828175665afa3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa3e1 expref: 6 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403165.751934:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001934f36a, rc 0) 00000100:00100000:0.0:1784403165.751969:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d2ebf90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+6:6272:x1871082260791680:12345-0@lo:101: Request processed in 153us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403165.751975:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784403165.752226:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0285550 going to sleep for 11 seconds 00000100:00100000:3.0:1784403165.752244:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260791680:0@lo:101: 00010000:00010000:3.0:1784403165.752260:0:6272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 0000000072ecf35a/0x6828175665afa3e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.752269:0:6272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 0000000072ecf35a/0x6828175665afa3e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403165.752321:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260791808:0@lo:501: 00000100:00100000:3.0:1784403165.752348:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403165.752367:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0285550 going to sleep for 11 seconds 00000100:00100000:0.0:1784403165.752429:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260791808 00000100:00100000:0.0:1784403165.752434:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260791808 00000100:00100000:0.0:1784403165.752456:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784403165.752463:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eaa8ad98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+6:6272:x1871082260791808:12345-0@lo:501: 00000100:00100000:0.0:1784403165.752739:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eaa8ad98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+6:6272:x1871082260791808:12345-0@lo:501: Request processed in 275us (389us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784403165.752747:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784403165.753034:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260791808:0@lo:501: 10000000:01000000:3.0:1784403165.753065:0:6272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784403165.753085:0:6272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 0000000072ecf35a/0x6828175665afa3e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.753095:0:6272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 0000000072ecf35a/0x6828175665afa3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403165.753105:0:6272:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c8a5270b000 10000000:01000000:3.0:1784403165.753110:0:6272:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784403165.753114:0:6272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c8a5270b000 10000000:01000000:3.0:1784403165.753116:0:6272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784403165.753119:0:6272:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c8a5270b000 from 1 10000000:01000000:3.0:1784403165.753122:0:6272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784403165.753142:0:6272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 0000000015a51b10/0x6828175665afa3ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.753162:0:6272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 0000000015a51b10/0x6828175665afa3ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.753171:0:6272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 0000000015a51b10/0x6828175665afa3ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403165.753186:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260791936:0@lo:101: 00000100:00100000:3.0:1784403165.753214:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403165.753543:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260791936 00000100:00100000:2.0:1784403165.753550:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260791936 00000100:00100000:2.0:1784403165.753594:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784403165.753609:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ac2d06c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+6:6272:x1871082260791936:12345-0@lo:101: 00010000:00010000:2.0:1784403165.753619:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403165.753934:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009508109c/0x6828175665afa3f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa3ef expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.753962:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009508109c/0x6828175665afa3f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa3ef expref: 7 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.753974:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009508109c/0x6828175665afa3f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa3ef expref: 7 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.753982:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009508109c, rc 0) 00000100:00100000:2.0:1784403165.754022:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ac2d06c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+7:6272:x1871082260791936:12345-0@lo:101: Request processed in 413us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403165.754029:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784403165.754189:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0285550 going to sleep for 11 seconds 00000100:00100000:3.0:1784403165.754211:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260791936:0@lo:101: 00010000:00010000:3.0:1784403165.754225:0:6272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 0000000015a51b10/0x6828175665afa3ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.754234:0:6272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 0000000015a51b10/0x6828175665afa3ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403165.754248:0:6272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784403165.754300:0:6272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 0000000015a51b10/0x6828175665afa3ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.754307:0:6272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 0000000015a51b10/0x6828175665afa3ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403165.754313:0:6272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784403165.754317:0:6272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784403165.754322:0:6272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c8a5270b000 10000000:01000000:3.0:1784403165.754325:0:6272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784403165.754328:0:6272:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784403165.754340:0:6272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784403165.754359:0:6272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000431ce74f/0x6828175665afa3fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.754366:0:6272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000431ce74f/0x6828175665afa3fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.754372:0:6272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000431ce74f/0x6828175665afa3fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403165.754386:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792064:0@lo:101: 00000100:00100000:3.0:1784403165.754416:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403165.754444:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0285550 going to sleep for 11 seconds 00000100:00100000:2.0:1784403165.754505:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260792064 00000100:00100000:2.0:1784403165.754510:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260792064 00000100:00100000:2.0:1784403165.754543:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784403165.754550:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed076f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+7:6272:x1871082260792064:12345-0@lo:101: 00010000:00010000:2.0:1784403165.754558:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403165.754567:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ebe14616/0x6828175665afa404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa3fd expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.754900:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ebe14616/0x6828175665afa404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa3fd expref: 8 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.754909:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ebe14616/0x6828175665afa404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa3fd expref: 8 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403165.754917:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ebe14616, rc 0) 00000100:00100000:2.0:1784403165.754952:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed076f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+8:6272:x1871082260792064:12345-0@lo:101: Request processed in 404us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403165.754958:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784403165.755027:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792064:0@lo:101: 00010000:00010000:3.0:1784403165.755037:0:6272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000431ce74f/0x6828175665afa3fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403165.755044:0:6272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000431ce74f/0x6828175665afa3fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403165.755095:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792192:0@lo:501: 00000100:00100000:3.0:1784403165.755116:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403165.755132:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0285550 going to sleep for 11 seconds 00000100:00100000:1.0:1784403165.755185:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260792192 00000100:00100000:1.0:1784403165.755189:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260792192 00000100:00100000:1.0:1784403165.755218:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403165.755223:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000434d1999 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+8:6272:x1871082260792192:12345-0@lo:501: 00000100:00100000:1.0:1784403165.755493:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000434d1999 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+9:6272:x1871082260792192:12345-0@lo:501: Request processed in 269us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403165.755501:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784403165.755848:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083389e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792192:0@lo:501: 00000100:00100000:2.0:1784403165.756046:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792320:0@lo:503: 00000100:00100000:2.0:1784403165.756082:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403165.756142:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 000000001d26f4fb going to sleep for 11 seconds 00000100:00100000:0.0:1784403165.756174:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260792320 00000100:00100000:0.0:1784403165.756178:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260792320 00000100:00100000:0.0:1784403165.756242:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784403165.756249:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d722fd73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+9:6272:x1871082260792320:12345-0@lo:503: 00000100:00100000:0.0:1784403165.756421:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d722fd73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+9:6272:x1871082260792320:12345-0@lo:503: Request processed in 173us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403165.756428:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784403165.756498:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792320:0@lo:503: 00000100:00100000:2.0:1784403165.757066:0:6315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6315:1871082260792448:0@lo:502: 00000100:00100000:2.0:1784403165.757107:0:6315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403165.757392:0:6315:0:(client.c:2702:ptlrpc_set_wait()) set 000000003a2d3780 going to sleep for 11 seconds 00000100:00100000:1.0:1784403165.757474:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260792448 00000100:00100000:1.0:1784403165.757481:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260792448 00000100:00100000:1.0:1784403165.757509:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784403165.757515:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013bf3aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+9:6315:x1871082260792448:12345-0@lo:502: 00000100:00100000:1.0:1784403165.757991:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013bf3aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+9:6315:x1871082260792448:12345-0@lo:502: Request processed in 474us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403165.757998:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784403165.758100:0:6315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6315:1871082260792448:0@lo:502: 00000020:01000000:2.0:1784403165.758138:0:6315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784403165.758153:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403165.758157:0:6315:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784403165.758163:0:6315:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784403165.758166:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784403165.758190:0:6315:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000006d356ecd) 00000020:00000080:2.0:1784403165.758219:0:6315:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784403165.758226:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784403165.758306:0:6315:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784403165.758313:0:6315:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afa412 00000020:00000080:2.0:1784403165.758541:0:6315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784403165.758546:0:6315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403165.758549:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403165.758551:0:6315:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784403165.758554:0:6315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784403165.758557:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403165.758558:0:6315:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784403165.758561:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784403165.758569:0:6315:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b2480218) 00000020:00000080:2.0:1784403165.758591:0:6315:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784403165.758596:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784403165.758605:0:6315:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784403165.758608:0:6315:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784403165.758614:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784403165.758937:0:6315:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ffa805f0 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784403165.758952:0:6315:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cc0a704e) 00000020:00000080:2.0:1784403165.758960:0:6315:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784403165.759017:0:6315:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784403165.759035:0:6315:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6828175665afa427 00000020:00000080:2.0:1784403165.759141:0:6315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784403165.759147:0:6315:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784403165.759152:0:6315:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6828175665afa42e 00080000:01000000:2.0:1784403165.759156:0:6315:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784403165.759160:0:6315:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afa435 00080000:10000000:2.0:1784403165.759570:0:6315:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1784403165.760226:0:6315:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1784403165.767586:0:6315:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1784403165.859540:0:6315:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1784403165.861947:0:6315:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1784403165.870791:0:6315:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1784403165.871175:0:6315:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784403165.959821:0:6315:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009aec62d0) 00000020:00000080:3.0:1784403165.959901:0:6315:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784403165.959977:0:6315:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784403165.959984:0:6315:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afa443 00000020:00000080:3.0:1784403165.960303:0:6315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1784403165.970804:0:6315:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403166.046414:0:6315:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:2.0:1784403166.047029:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1784403166.098741:0:6315:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403166.151554:0:6315:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403166.213568:0:6315:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784403166.259358:0:6315:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1784403166.292369:0:6315:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6828175665afa44a 00000020:00000080:1.0:1784403166.293089:0:6315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784403166.293105:0:6315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403166.293113:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403166.293116:0:6315:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784403166.293119:0:6315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403166.293123:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403166.293124:0:6315:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784403166.293127:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784403166.293128:0:6315:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784403166.293132:0:6315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403166.293134:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403166.293135:0:6315:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784403166.293137:0:6315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403166.293141:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403166.293150:0:6315:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784403166.293156:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784403166.293200:0:6315:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1784403166.293349:0:6315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a4adc9d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6315:1871082260792576:0@lo:502: 00000100:00100000:1.0:1784403166.293450:0:6315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403166.293519:0:6315:0:(client.c:2702:ptlrpc_set_wait()) set 000000006dad2bb9 going to sleep for 11 seconds 00000100:00100000:3.0:1784403166.293684:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260792576 00000100:00100000:3.0:1784403166.293692:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260792576 00000100:00100000:3.0:1784403166.293741:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784403166.293809:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096b0ae04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+9:6315:x1871082260792576:12345-0@lo:502: 00000100:00100000:3.0:1784403166.294169:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096b0ae04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+9:6315:x1871082260792576:12345-0@lo:502: Request processed in 361us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403166.294178:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784403166.294357:0:6315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a4adc9d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6315:1871082260792576:0@lo:502: 00000020:01000000:0.0:1784403166.294386:0:6315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403166.294392:0:6315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403166.294394:0:6315:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1784403166.294398:0:6315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1784403166.294605:0:6272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1784403166.294691:0:6272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784403166.294711:0:6272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000431ce74f/0x6828175665afa3fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.294721:0:6272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000431ce74f/0x6828175665afa3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403166.294728:0:6272:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c8a5270b000 from 1 10000000:01000000:3.0:1784403166.294731:0:6272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784403166.294901:0:6272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.294910:0:6272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.294918:0:6272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403166.294935:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792704:0@lo:101: 00000100:00100000:3.0:1784403166.294979:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403166.295005:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000249759bd going to sleep for 11 seconds 00000100:00100000:0.0:1784403166.295081:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260792704 00000100:00100000:0.0:1784403166.295093:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260792704 00000100:00100000:0.0:1784403166.295132:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784403166.295140:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d7f187c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+9:6272:x1871082260792704:12345-0@lo:101: 00010000:00010000:0.0:1784403166.295150:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403166.295164:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eab5310f/0x6828175665afa458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa451 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403166.295186:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eab5310f/0x6828175665afa458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa451 expref: 10 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403166.295198:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eab5310f/0x6828175665afa458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa451 expref: 10 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403166.295207:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eab5310f, rc 0) 00000100:00100000:0.0:1784403166.295314:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d7f187c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+10:6272:x1871082260792704:12345-0@lo:101: Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403166.295321:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784403166.295449:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792704:0@lo:101: 00010000:00010000:3.0:1784403166.295463:0:6272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.295471:0:6272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403166.296385:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792832:0@lo:256: 00000100:00100000:3.0:1784403166.296438:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403166.296522:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000249759bd going to sleep for 11 seconds 00000100:00100000:1.0:1784403166.296571:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260792832 00000100:00100000:1.0:1784403166.296578:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260792832 00000100:00100000:1.0:1784403166.296719:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784403166.296727:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ab4cf64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+10:6272:x1871082260792832:12345-0@lo:256: 20000000:01000000:1.0:1784403166.296754:0:6287:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784403166.296760:0:6287:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1784403166.296840:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ab4cf64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+10:6272:x1871082260792832:12345-0@lo:256: Request processed in 114us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403166.296856:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784403166.296947:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792832:0@lo:256: 10000000:01000000:3.0:1784403166.297544:0:6272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784403166.297572:0:6272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.297582:0:6272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403166.297590:0:6272:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a5270b000 from 1 10000000:01000000:3.0:1784403166.297593:0:6272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784403166.297618:0:6272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.297638:0:6272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.297646:0:6272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403166.297672:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792960:0@lo:101: 00000100:00100000:3.0:1784403166.297710:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403166.298259:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000249759bd going to sleep for 11 seconds 00000100:00100000:0.0:1784403166.298362:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260792960 00000100:00100000:0.0:1784403166.298370:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260792960 00000100:00100000:0.0:1784403166.298407:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784403166.298414:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009eacb6e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+10:6272:x1871082260792960:12345-0@lo:101: 00010000:00010000:0.0:1784403166.298427:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403166.298440:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a94fb8a8/0x6828175665afa466 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa45f expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403166.298465:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a94fb8a8/0x6828175665afa466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa45f expref: 11 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403166.298476:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a94fb8a8/0x6828175665afa466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa45f expref: 11 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403166.298498:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a94fb8a8, rc 0) 00000100:00100000:0.0:1784403166.298546:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009eacb6e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+11:6272:x1871082260792960:12345-0@lo:101: Request processed in 132us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403166.298553:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784403166.298721:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260792960:0@lo:101: 00010000:00010000:3.0:1784403166.298740:0:6272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.298820:0:6272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403166.298921:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260793088:0@lo:501: 00000100:00100000:3.0:1784403166.298946:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403166.298963:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000249759bd going to sleep for 11 seconds 00000100:00100000:0.0:1784403166.299020:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260793088 00000100:00100000:0.0:1784403166.299024:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260793088 00000100:00100000:0.0:1784403166.299044:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784403166.299049:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae70427d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+11:6272:x1871082260793088:12345-0@lo:501: 00000100:00100000:0.0:1784403166.299953:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae70427d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+11:6272:x1871082260793088:12345-0@lo:501: Request processed in 903us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403166.299963:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784403166.300158:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260793088:0@lo:501: 00000100:00100000:3.0:1784403166.300197:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260793216:0@lo:503: 00000100:00100000:3.0:1784403166.300356:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403166.300387:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000249759bd going to sleep for 11 seconds 00000100:00100000:0.0:1784403166.300431:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260793216 00000100:00100000:0.0:1784403166.300436:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260793216 00000100:00100000:0.0:1784403166.300508:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784403166.300516:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006eb08cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+11:6272:x1871082260793216:12345-0@lo:503: 00000040:00080000:0.0:1784403166.300555:0:6285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784403166.300602:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006eb08cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+11:6272:x1871082260793216:12345-0@lo:503: Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403166.300608:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784403166.300683:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260793216:0@lo:503: 00000040:00080000:2.0:1784403166.302336:0:6319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1784403166.302541:0:6272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1784403166.302562:0:6272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784403166.302584:0:6272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.302596:0:6272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403166.302823:0:6272:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784403166.302826:0:6272:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c8a5270b000 10000000:01000000:3.0:1784403166.302829:0:6272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c8a5270b000 10000000:01000000:3.0:1784403166.302833:0:6272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784403166.302839:0:6272:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a5270b000 from 1 10000000:01000000:3.0:1784403166.302850:0:6272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784403166.302925:0:6272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000a12d3dd4/0x6828175665afa46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.302933:0:6272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000a12d3dd4/0x6828175665afa46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403166.302944:0:6272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000a12d3dd4/0x6828175665afa46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403166.302969:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260793344:0@lo:101: 00000100:00100000:3.0:1784403166.303034:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403166.303064:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000249759bd going to sleep for 11 seconds 00000100:00100000:1.0:1784403166.303174:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260793344 00000100:00100000:1.0:1784403166.303183:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260793344 00000100:00100000:1.0:1784403166.303236:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784403166.303326:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd1be033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+11:6272:x1871082260793344:12345-0@lo:101: 00010000:00010000:1.0:1784403166.303342:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403166.303358:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058430d06/0x6828175665afa474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa46d expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.303386:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058430d06/0x6828175665afa474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa46d expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.303395:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058430d06/0x6828175665afa474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa46d expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.303417:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058430d06, rc 0) 00000100:00100000:1.0:1784403166.303471:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd1be033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:6272:x1871082260793344:12345-0@lo:101: Request processed in 148us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403166.303478:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784403166.303572:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000241e3df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260793344:0@lo:101: 00010000:00010000:2.0:1784403166.303589:0:6272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000a12d3dd4/0x6828175665afa46d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.303597:0:6272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000a12d3dd4/0x6828175665afa46d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403166.303721:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260793472:0@lo:501: 00000100:00100000:2.0:1784403166.303825:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403166.303889:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b3944572 going to sleep for 11 seconds 00000100:00100000:1.0:1784403166.303953:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260793472 00000100:00100000:1.0:1784403166.303957:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260793472 00000100:00100000:1.0:1784403166.303989:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784403166.303995:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fa4db8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:6272:x1871082260793472:12345-0@lo:501: 00000100:00100000:1.0:1784403166.304340:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fa4db8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:6272:x1871082260793472:12345-0@lo:501: Request processed in 344us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403166.304348:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784403166.304427:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260793472:0@lo:501: 00000100:00100000:2.0:1784403166.304458:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260793600:0@lo:503: 00000100:00100000:2.0:1784403166.304497:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403166.304519:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b3944572 going to sleep for 11 seconds 00000100:00100000:1.0:1784403166.304570:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260793600 00000100:00100000:1.0:1784403166.304574:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260793600 00000100:00100000:1.0:1784403166.304677:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784403166.304685:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c46bcbce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:6272:x1871082260793600:12345-0@lo:503: 00000100:00100000:1.0:1784403166.305060:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c46bcbce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:6272:x1871082260793600:12345-0@lo:503: Request processed in 376us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403166.305067:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784403166.305443:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260793600:0@lo:503: 00000100:00100000:2.0:1784403166.305822:0:6320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6320:1871082260793728:0@lo:502: 00000100:00100000:2.0:1784403166.305897:0:6320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403166.305925:0:6320:0:(client.c:2702:ptlrpc_set_wait()) set 0000000048ef6ba7 going to sleep for 11 seconds 00000100:00100000:0.0:1784403166.306031:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260793728 00000100:00100000:0.0:1784403166.306036:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260793728 00000100:00100000:0.0:1784403166.306061:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784403166.306067:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000804fb430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:6320:x1871082260793728:12345-0@lo:502: 00000100:00100000:0.0:1784403166.306325:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000804fb430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:6320:x1871082260793728:12345-0@lo:502: Request processed in 258us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403166.306333:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784403166.306470:0:6320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6320:1871082260793728:0@lo:502: 00000020:01000004:2.0:1784403166.306529:0:6320:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784403166.306544:0:6320:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005c381423) 00000020:00000080:2.0:1784403166.306564:0:6320:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1784403166.308926:0:6320:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ffa805f0 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784403166.308948:0:6320:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ffa805f0 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784403166.308951:0:6320:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ffa805f0 4 00010000:00080000:2.0:1784403166.308992:0:6320:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000d1b5e97@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:2.0:1784403166.310971:0:6320:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1784403166.311070:0:6320:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784403166.311107:0:6320:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784403166.311118:0:6320:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6828175665afa482 00000100:00080000:2.0:1784403166.311128:0:6320:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784403166.311133:0:6320:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000d1b5e97 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1784403166.311167:0:6320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c61a6a1e x1871082260793856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784403166.311197:0:6320:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784403166.311914:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3564:1871082260793856:0@lo:38: 00000100:00100000:0.0:1784403166.312003:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403166.312132:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260793856 00000100:00100000:3.0:1784403166.312140:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260793856 00000100:00100000:3.0:1784403166.312180:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784403166.312187:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000886a65b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3564:x1871082260793856:12345-0@lo:38: 00000100:00100000:0.0:1784403166.312351:0:3564:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784403166.312359:0:3564:0:(import.c:65:import_set_state_nolock()) 000000000d1b5e97 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784403166.312363:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784403166.312366:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c61a6a1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3564:1871082260793856:0@lo:38: 00000100:00100000:3.0:1784403166.312413:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000886a65b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3564:x1871082260793856:12345-0@lo:38: Request processed in 225us (409us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784403166.312421:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403166.312568:0:6320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b1e9699e pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6320:1871082260793984:0@lo:502: 00000100:00100000:2.0:1784403166.312615:0:6320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403166.312889:0:6320:0:(client.c:2702:ptlrpc_set_wait()) set 0000000048ef6ba7 going to sleep for 11 seconds 00000100:00100000:0.0:1784403166.314365:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260793984 00000100:00100000:0.0:1784403166.314377:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260793984 00000100:00100000:0.0:1784403166.314434:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784403166.314443:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002945cb99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:6320:x1871082260793984:12345-0@lo:502: 00000100:00100000:0.0:1784403166.314935:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002945cb99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:6320:x1871082260793984:12345-0@lo:502: Request processed in 493us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403166.314944:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784403166.315077:0:6320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b1e9699e pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6320:1871082260793984:0@lo:502: 00000040:00080000:2.0:1784403166.315115:0:6320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1784403166.315382:0:6272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1784403166.315402:0:6272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784403166.315456:0:6272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000a12d3dd4/0x6828175665afa46d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403166.315467:0:6272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000a12d3dd4/0x6828175665afa46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784403166.315517:0:6272:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784403166.315520:0:6272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784403166.315521:0:6272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784403166.315523:0:6272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784403166.315524:0:6272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784403166.315525:0:6272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784403166.315527:0:6272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784403166.315528:0:6272:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784403166.315529:0:6272:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784403166.315534:0:6272:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784403166.315535:0:6272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784403166.315536:0:6272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784403166.315540:0:6272:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1784403166.315542:0:6272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784403166.315544:0:6272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784403166.315545:0:6272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784403166.315546:0:6272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784403166.315547:0:6272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784403166.315548:0:6272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784403166.315548:0:6272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784403166.315549:0:6272:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784403166.315550:0:6272:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784403166.315551:0:6272:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784403166.315552:0:6272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784403166.315553:0:6272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784403166.315571:0:6272:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784403166.315584:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ce0da62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260794112:0@lo:253: 00000100:00100000:0.0:1784403166.315634:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403166.315666:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 000000007852a8f6 going to sleep for 11 seconds 00000100:00100000:0.0:1784403166.315682:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260794112 00000100:00100000:0.0:1784403166.315687:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260794112 00000100:00100000:0.0:1784403166.315716:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784403166.315723:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bd7c5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:6272:x1871082260794112:12345-0@lo:253: 20000000:01000000:0.0:1784403166.317358:0:6287:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784403166.317383:0:6287:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784403166.353439:0:6287:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784403166.353462:0:6287:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784403166.353516:0:6308:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784403166.353523:0:6308:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784403166.353544:0:6308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.353564:0:6308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000eab5310f/0x6828175665afa458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa451 expref: 12 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.353586:0:6308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.353643:0:6308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000eab5310f/0x6828175665afa458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa451 expref: 12 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.353676:0:6308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000eab5310f/0x6828175665afa458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa451 expref: 12 pid: 6285 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403166.353692:0:6308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b1e9699e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6308:1871082260794240:0@lo:104: 00000100:00100000:2.0:1784403166.353780:0:6308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403166.353856:0:6308:0:(client.c:2702:ptlrpc_set_wait()) set 0000000092ae7ec4 going to sleep for 11 seconds 00000100:00100000:0.0:1784403166.354029:0:6274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260794240 00000100:00100000:0.0:1784403166.354037:0:6274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260794240 00000100:00100000:0.0:1784403166.354088:0:6274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784403166.354097:0:6274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003390fad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+3:6308:x1871082260794240:12345-0@lo:104: 00010000:00010000:0.0:1784403166.354110:0:6274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403166.354175:0:6274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784403166.354180:0:6274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003390fad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+3:6308:x1871082260794240:12345-0@lo:104: Request processed in 85us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403166.354188:0:6274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403166.354332:0:6308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b1e9699e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6308:1871082260794240:0@lo:104: 00010000:00010000:2.0:1784403166.354354:0:6308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.355129:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784403166.355136:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.355146:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003cfead43 already unused, calling callback (00000000d837adcf) 10000000:00010000:2.0:1784403166.355149:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.355157:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784403166.355163:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403166.355168:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784403166.355926:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.355937:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784403166.355968:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.355974:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: 000000003cfead43/0x6828175665afa451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa458 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403166.355993:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403166.355995:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403166.355996:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403166.356062:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b1e9699e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260794368:0@lo:103: 00000100:00100000:2.0:1784403166.356123:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403166.356366:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260794368 00000100:00100000:1.0:1784403166.356376:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260794368 00010000:00010000:1.0:1784403166.356405:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000eab5310f/0x6828175665afa458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa451 expref: 13 pid: 6285 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403166.356436:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784403166.356444:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f67c3d4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+13:3566:x1871082260794368:12345-0@lo:103: 00010000:00010000:1.0:1784403166.356455:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403166.356466:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000eab5310f/0x6828175665afa458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa451 expref: 13 pid: 6285 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356476:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000eab5310f/0x6828175665afa458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa451 expref: 13 pid: 6285 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356488:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eab5310f/0x6828175665afa458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa451 expref: 13 pid: 6285 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356503:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356511:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784403166.356526:0:6276:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003004581s 00010000:00010000:1.0:1784403166.356530:0:6276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356537:0:6276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356543:0:6276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356549:0:6276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356554:0:6276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab75553c already unused, calling callback (0000000034a0205c) 00010000:00010000:1.0:1784403166.356557:0:6276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356563:0:6276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356595:0:6276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356605:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403166.356655:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f67c3d4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+12:3566:x1871082260794368:12345-0@lo:103: Request processed in 212us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403166.356662:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784403166.356703:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b1e9699e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260794368:0@lo:103: 00010000:00010000:1.0:1784403166.356723:0:6308:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356730:0:6308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403166.356736:0:6308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab75553c/0x6828175665afa489 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403166.365176:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bd7c5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+11:6272:x1871082260794112:12345-0@lo:253: Request processed in 49443us (49543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403166.365194:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784403166.365380:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ce0da62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:6272:1871082260794112:0@lo:253: 10000000:01000000:2.0:1784403166.365397:0:6272:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784403166.365400:0:6272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784403166.365402:0:6272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784403166.365403:0:6272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403166.365404:0:6272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403166.365405:0:6272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403166.365406:0:6272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403166.365408:0:6272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784403166.365410:0:6272:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784403166.365411:0:6272:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784403166.365412:0:6272:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784403166.365414:0:6272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403166.365415:0:6272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784403166.365430:0:6272:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784403166.371205:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403166.371633:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784403166.372211:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403166.372417:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784403166.376303:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403166.376585:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1784403166.378079:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1784403166.378288:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1784403166.378499:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1784403166.378977:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1784403166.379215:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1784403166.379419:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1784403166.423729:0:6272:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1784403166.467815:0:6272:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1784403166.468389:0:6326:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1784403166.470891:0:6325:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1784403166.470897:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1784403166.472121:0:6272:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784403166.472306:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784403166.473007:0:6272:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784403166.473019:0:6272:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784403166.473196:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784403166.474861:0:6272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784403166.475437:0:6272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784403166.475467:0:6272:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784403166.476013:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784403166.476292:0:6272:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1784403166.478407:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1784403166.478560:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1784403166.479146:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1784403166.479318:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1784403166.479485:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1784403166.479941:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1784403166.480123:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1784403166.480272:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1784403166.480437:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1784403166.484896:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1784403166.485185:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1784403166.485359:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1784403166.485533:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1784403166.488279:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1784403166.488532:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1784403166.488724:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1784403166.489102:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1784403166.489286:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1784403166.489466:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1784403166.489643:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1784403166.489807:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1784403166.490036:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1784403166.490197:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1784403166.490353:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1784403166.490525:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1784403166.490682:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1784403166.490818:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1784403166.496125:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1784403166.496322:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1784403166.496490:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1784403166.496768:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1784403166.496974:0:6272:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1784403166.497851:0:6272:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1784403166.530511:0:6326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1784403166.596992:0:6272:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784403166.597035:0:6272:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3f141dc3988 00100000:10000000:1.0:1784403166.597043:0:6272:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:3.0:1784403166.599823:0:6326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784403166.599958:0:6326:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784403166.599964:0:6326:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:1.0:1784403166.605067:0:6272:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784403166.605089:0:6272:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784403166.605105:0:6272:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784403166.605135:0:6272:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1784403167.071383:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403168.100423:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403169.119617:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403170.145451:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403171.169232:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784403171.543733:0:6568:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1784403171.551200:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784403171.551235:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784403171.551238:0:38:0:(import.c:65:import_set_state_nolock()) 000000000d1b5e97 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784403171.551253:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000d1b5e97 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1784403171.551280:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007ca31ecf x1871082260794624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784403171.551359:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007ca31ecf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3564:1871082260794624:0@lo:38: 00000100:00100000:1.0:1784403171.551433:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403171.551678:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784403171.551695:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000238a6a57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260794496:0@lo:400: 00000100:00100000:3.0:1784403171.551731:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403171.551794:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260794496 00000100:00100000:3.0:1784403171.551803:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260794496 00000100:00100000:3.0:1784403171.551940:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784403171.551950:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000080b8777 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+11:3568:x1871082260794496:12345-0@lo:400: 00000100:00100000:3.0:1784403171.552000:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000080b8777 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+11:3568:x1871082260794496:12345-0@lo:400: Request processed in 52us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403171.552008:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784403171.552059:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000238a6a57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260794496:0@lo:400: 00000100:00100000:3.0:1784403171.552102:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260794624 00000100:00100000:3.0:1784403171.552106:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260794624 00000100:00100000:3.0:1784403171.552128:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784403171.552132:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c8806ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3564:x1871082260794624:12345-0@lo:38: 00010000:00080000:3.0:1784403171.552155:0:6294:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1784403171.552191:0:6294:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6828175665afa490 00000004:00100000:3.0:1784403171.552236:0:6294:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784403171.552351:0:6294:0:(import.c:65:import_set_state_nolock()) 000000009c891d60 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784403171.552392:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c8806ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3564:x1871082260794624:12345-0@lo:38: Request processed in 258us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403171.552399:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784403171.552435:0:3564:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007ca31ecf x1871082260794624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784403181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784403171.552450:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784403171.552457:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784403171.552462:0:3564:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784403171.552471:0:3564:0:(import.c:65:import_set_state_nolock()) 000000000d1b5e97 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784403171.552477:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007ca31ecf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3564:1871082260794624:0@lo:38: 10000000:01000000:0.0:1784403172.063073:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784403172.063315:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c8a5270b000 from 3 10000000:01000000:0.0:1784403172.063322:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784403172.063388:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000e2dcd53c/0x6828175665afa497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403172.063403:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000e2dcd53c/0x6828175665afa497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403172.063417:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000e2dcd53c/0x6828175665afa497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403172.063448:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000303876b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260794752:0@lo:101: 00000100:00100000:0.0:1784403172.063607:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403172.063716:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set 000000008404ce3c going to sleep for 11 seconds 00000100:00100000:1.0:1784403172.066728:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260794752 00000100:00100000:1.0:1784403172.066760:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260794752 00000100:00100000:1.0:1784403172.066986:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784403172.066998:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f13378 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+11:6290:x1871082260794752:12345-0@lo:101: 00010000:00010000:1.0:1784403172.067022:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403172.067048:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000178fea94/0x6828175665afa49e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa497 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403172.067087:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000178fea94/0x6828175665afa49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa497 expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403172.067100:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000178fea94/0x6828175665afa49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa497 expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403172.067112:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000178fea94, rc 0) 00000100:00100000:1.0:1784403172.067227:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f13378 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:6290:x1871082260794752:12345-0@lo:101: Request processed in 231us (3620us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403172.067234:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784403172.067387:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000303876b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260794752:0@lo:101: 00010000:00010000:2.0:1784403172.067409:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000e2dcd53c/0x6828175665afa497 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403172.067420:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000e2dcd53c/0x6828175665afa497 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403172.067527:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ef0c16bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260794880:0@lo:256: 00000100:00100000:2.0:1784403172.067572:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403172.069589:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260794880 00000100:00100000:2.0:1784403172.069717:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cddd5a1c going to sleep for 11 seconds 00000100:00100000:0.0:1784403172.069790:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260794880 00000100:00100000:0.0:1784403172.070065:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784403172.070075:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000311993f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:6290:x1871082260794880:12345-0@lo:256: 20000000:01000000:0.0:1784403172.070132:0:6285:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784403172.070153:0:6285:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784403172.070156:0:6285:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1784403172.070291:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000311993f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:6290:x1871082260794880:12345-0@lo:256: Request processed in 217us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403172.070298:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784403172.070417:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ef0c16bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260794880:0@lo:256: 10000000:01000000:2.0:1784403172.070490:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784403172.070501:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000e2dcd53c/0x6828175665afa497 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403172.070523:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000e2dcd53c/0x6828175665afa497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403172.193070:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403173.215057:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403174.242680:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403175.269985:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403176.291434:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403176.672019:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000069d4c5c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260795136:0@lo:400: 00000100:00100000:2.0:1784403176.672123:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403176.672250:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260795136 00000100:00100000:2.0:1784403176.672262:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260795136 00000100:00100000:2.0:1784403176.672367:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403176.672378:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027639374 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260795136:12345-0@lo:400: 00000100:00100000:2.0:1784403176.672659:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027639374 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260795136:12345-0@lo:400: Request processed in 282us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403176.672668:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784403176.672725:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000069d4c5c5 x1871082260795136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403176.672741:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000069d4c5c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260795136:0@lo:400: 00000100:00100000:1.0:1784403176.672829:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784403176.672842:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ef0c16bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260795008:0@lo:400: 00000100:00100000:1.0:1784403176.672935:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403176.673465:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260795008 00000100:00100000:2.0:1784403176.673474:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260795008 00000100:00100000:2.0:1784403176.673524:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784403176.673532:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f44c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:3567:x1871082260795008:12345-0@lo:400: 00000100:00100000:2.0:1784403176.673588:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f44c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:3567:x1871082260795008:12345-0@lo:400: Request processed in 57us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403176.673595:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784403176.673793:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ef0c16bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260795008:0@lo:400: 00010000:00010000:2.0:1784403177.315736:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784403177.400575:0:6770:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5596b200 20000000:00000080:3.0:1784403177.400599:0:6770:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c8a49ce3c00 uarg=0000000000000000 20000000:01000000:3.0:1784403177.401338:0:6770:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784403177.401351:0:6770:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784403177.401359:0:6770:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784403177.401628:0:6770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1784403177.401658:0:6770:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1784403177.409169:0:6770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784403177.409955:0:6770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784403177.410035:0:6770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1784403177.410090:0:6770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1784403177.410110:0:6770:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784403177.410135:0:6770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.410159:0:6770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a94fb8a8/0x6828175665afa466 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa45f expref: 11 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.410167:0:6770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.410217:0:6770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a94fb8a8/0x6828175665afa466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa45f expref: 11 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.410236:0:6770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a94fb8a8/0x6828175665afa466 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa45f expref: 11 pid: 6285 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403177.410268:0:6770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e986f117 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6770:1871082260795264:0@lo:104: 00000100:00100000:3.0:1784403177.410363:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403177.410444:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260795264 00000100:00100000:2.0:1784403177.410454:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260795264 00000100:00100000:2.0:1784403177.410507:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784403177.410517:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020ded50d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:6770:x1871082260795264:12345-0@lo:104: 00010000:00010000:2.0:1784403177.410532:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403177.410593:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784403177.410598:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020ded50d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:6770:x1871082260795264:12345-0@lo:104: Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403177.410602:0:6770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dd62a676 going to sleep for 11 seconds 00000100:00100000:2.0:1784403177.410605:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784403177.410629:0:6770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e986f117 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6770:1871082260795264:0@lo:104: 00010000:00010000:3.0:1784403177.410663:0:6770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403177.412502:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403177.412516:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403177.412530:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046d94ea4 already unused, calling callback (00000000d837adcf) 10000000:00010000:0.0:1784403177.412533:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403177.412543:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784403177.412551:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403177.412556:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784403177.412616:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403177.412622:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784403177.412689:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b7886a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260795392:0@lo:103: 00000100:00100000:1.0:1784403177.412770:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403177.412856:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260795392 00000100:00100000:3.0:1784403177.412896:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260795392 00010000:00010000:3.0:1784403177.412931:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a94fb8a8/0x6828175665afa466 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa45f expref: 12 pid: 6285 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403177.412966:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784403177.412974:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000801e7344 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+12:3566:x1871082260795392:12345-0@lo:103: 00010000:00010000:3.0:1784403177.412989:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403177.412994:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a94fb8a8/0x6828175665afa466 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa45f expref: 12 pid: 6285 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413006:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a94fb8a8/0x6828175665afa466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa45f expref: 12 pid: 6285 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413024:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a94fb8a8/0x6828175665afa466 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa45f expref: 12 pid: 6285 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413041:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413049:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413078:0:6276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413085:0:6276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413091:0:6276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413096:0:6276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413101:0:6276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003cfead43 already unused, calling callback (0000000034a0205c) 00010000:00010000:3.0:1784403177.413104:0:6276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413110:0:6276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413122:0:6276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413132:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403177.413385:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403177.413393:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: 0000000046d94ea4/0x6828175665afa45f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa466 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403177.413480:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403177.413483:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403177.413485:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403177.413569:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000801e7344 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+11:3566:x1871082260795392:12345-0@lo:103: Request processed in 595us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403177.413578:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1784403177.413716:0:6770:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413796:0:6770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403177.413808:0:6770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003cfead43/0x6828175665afa4a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403177.415156:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b7886a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260795392:0@lo:103: 00010000:00010000:2.0:1784403178.336776:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403179.362744:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403180.386530:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784403180.832757:0:6290:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784403180.832769:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a5270b000 from 1 10000000:01000000:2.0:1784403180.832776:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784403180.832843:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000efa6470e/0x6828175665afa4ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403180.832858:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000efa6470e/0x6828175665afa4ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403180.832889:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000efa6470e/0x6828175665afa4ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403180.832924:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000069d4c5c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260795520:0@lo:101: 00000100:00100000:2.0:1784403180.833026:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403180.833101:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set 000000008dc4bf2b going to sleep for 11 seconds 00000100:00100000:0.0:1784403180.833855:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260795520 00000100:00100000:0.0:1784403180.833883:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260795520 00000100:00100000:0.0:1784403180.833968:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784403180.833979:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039473232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+11:6290:x1871082260795520:12345-0@lo:101: 00010000:00010000:0.0:1784403180.834003:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403180.834026:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eab5310f/0x6828175665afa4b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa4ac expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403180.834064:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eab5310f/0x6828175665afa4b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa4ac expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403180.834079:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eab5310f/0x6828175665afa4b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa4ac expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403180.834091:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eab5310f, rc 0) 00000100:00100000:0.0:1784403180.834182:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039473232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:6290:x1871082260795520:12345-0@lo:101: Request processed in 204us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403180.834190:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784403180.834268:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000069d4c5c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260795520:0@lo:101: 00010000:00010000:0.0:1784403180.834288:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000efa6470e/0x6828175665afa4ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403180.834298:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000efa6470e/0x6828175665afa4ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403180.834517:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008270e958 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260795648:0@lo:501: 00000100:00100000:0.0:1784403180.834558:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403180.834608:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e8558eb1 going to sleep for 11 seconds 00000100:00100000:0.0:1784403180.834627:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260795648 00000100:00100000:0.0:1784403180.834631:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260795648 00000100:00100000:0.0:1784403180.834655:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784403180.834662:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054318b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:6290:x1871082260795648:12345-0@lo:501: 00000100:00100000:0.0:1784403180.835030:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054318b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:6290:x1871082260795648:12345-0@lo:501: Request processed in 368us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403180.835039:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784403180.835077:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008270e958 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260795648:0@lo:501: 00000100:00100000:0.0:1784403180.835115:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008270e958 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260795776:0@lo:503: 00000100:00100000:0.0:1784403180.835159:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403180.835182:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da8e1153 going to sleep for 11 seconds 00000100:00100000:0.0:1784403180.835196:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260795776 00000100:00100000:0.0:1784403180.835199:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260795776 00000100:00100000:0.0:1784403180.835220:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784403180.835226:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef20bbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:6290:x1871082260795776:12345-0@lo:503: 00000100:00100000:0.0:1784403180.837770:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef20bbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:6290:x1871082260795776:12345-0@lo:503: Request processed in 2536us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403180.837788:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784403180.837913:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008270e958 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260795776:0@lo:503: 00000100:00100000:2.0:1784403180.851070:0:6953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000789068fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6953:1871082260795904:0@lo:502: 00000100:00100000:2.0:1784403180.851217:0:6953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403180.851290:0:6953:0:(client.c:2702:ptlrpc_set_wait()) set 000000008dc4bf2b going to sleep for 11 seconds 00000100:00100000:0.0:1784403180.857098:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260795904 00000100:00100000:0.0:1784403180.857116:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260795904 00000100:00100000:0.0:1784403180.857193:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784403180.857204:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed525767 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:6953:x1871082260795904:12345-0@lo:502: 00000100:00100000:0.0:1784403180.857520:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed525767 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:6953:x1871082260795904:12345-0@lo:502: Request processed in 318us (6304us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403180.857529:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784403180.857930:0:6953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000789068fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6953:1871082260795904:0@lo:502: 00000020:01000000:2.0:1784403180.857977:0:6953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784403180.857990:0:6953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403180.857993:0:6953:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784403180.858001:0:6953:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a5270b000 00000020:00000080:2.0:1784403180.858005:0:6953:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784403180.858070:0:6953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6953:1871082260796032:0@lo:502: 00000100:00100000:2.0:1784403180.858127:0:6953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403180.858176:0:6953:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7349d240 going to sleep for 11 seconds 00000100:00100000:0.0:1784403180.858263:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260796032 00000100:00100000:0.0:1784403180.858269:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260796032 00000100:00100000:0.0:1784403180.858299:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784403180.858305:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:6953:x1871082260796032:12345-0@lo:502: 00000100:00100000:0.0:1784403180.858508:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:6953:x1871082260796032:12345-0@lo:502: Request processed in 202us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403180.858515:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784403180.858599:0:6953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:6953:1871082260796032:0@lo:502: 00000020:01000000:2.0:1784403180.858625:0:6953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403180.858630:0:6953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403180.858632:0:6953:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784403180.858685:0:6953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1784403180.858995:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784403180.859021:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784403180.859034:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ae00/0x6828175665afa4ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403180.859048:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ae00/0x6828175665afa4ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403181.408132:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403181.792657:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260796160:0@lo:400: 00000100:00100000:0.0:1784403181.792764:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403181.792856:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784403181.792862:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260796288:0@lo:400: 00000100:00100000:0.0:1784403181.792925:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403181.793025:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260796160 00000100:00100000:2.0:1784403181.793026:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260796288 00000100:00100000:2.0:1784403181.793035:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260796288 00000100:00100000:1.0:1784403181.793035:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260796160 00000100:00100000:2.0:1784403181.793085:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784403181.793085:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784403181.793094:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260796288:12345-0@lo:400: 00000100:00100000:1.0:1784403181.793094:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:3567:x1871082260796160:12345-0@lo:400: 00000100:00100000:1.0:1784403181.793210:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:3567:x1871082260796160:12345-0@lo:400: Request processed in 117us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403181.793218:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784403181.802710:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260796288:12345-0@lo:400: Request processed in 9602us (9768us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403181.802730:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784403181.812863:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c8a58091c00 x1871082260796288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403181.812943:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260796288:0@lo:400: 00000100:00100000:1.0:1784403181.812962:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260796160:0@lo:400: 00010000:00010000:3.0:1784403182.433841:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403183.460158:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784403184.207486:0:7097:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784403184.207493:0:7097:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1784403184.207683:0:7097:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c8a43036800 00000020:01000004:1.0:1784403184.207706:0:7097:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784403184.207722:0:7097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1784403184.207739:0:7097:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c8a580999c0) 00000020:00000080:1.0:1784403184.207761:0:7097:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784403184.242081:0:7097:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1784403184.242456:0:7097:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784403184.273409:0:7097:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784403184.280099:0:7097:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784403184.280144:0:7097:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784403184.280220:0:7097:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784403184.280344:0:7097:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784403184.281083:0:7097:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784403184.281099:0:7097:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784403184.281118:0:7097:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6828175665afa4c1 00000020:01000004:3.0:1784403184.281132:0:7097:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1784403184.281159:0:7097:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.128@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784403184.281163:0:7097:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784403184.281170:0:7097:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784403184.281175:0:7097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1784403184.281208:0:7097:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c8a527a3380) 00000020:00000080:3.0:1784403184.281225:0:7097:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1784403184.283463:0:7097:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784403184.284147:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1784403184.284166:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1784403184.292283:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1784403184.292307:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1784403184.296446:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1784403184.296465:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1784403184.300323:0:7097:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784403184.301335:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1784403184.301354:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1784403184.303110:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1784403184.303127:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1784403184.343071:0:7097:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784403184.343418:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784403184.343425:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1784403184.345515:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784403184.345708:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1784403184.346573:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784403184.346701:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1784403184.350796:0:7097:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784403184.351168:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1784403184.351175:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1784403184.352525:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1784403184.352539:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1784403184.430145:0:7097:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784403184.433715:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1784403184.433730:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1784403184.445496:0:7097:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1784403184.445541:0:7097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784403184.447400:0:7097:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784403184.447437:0:7097:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1784403184.447446:0:7097:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:3.0:1784403184.479411:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1784403184.484344:0:7097:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784403184.484398:0:7097:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.128@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1784403184.484402:0:7097:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784403184.484403:0:7097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784403184.484405:0:7097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784403184.484406:0:7097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784403184.484407:0:7097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784403184.484408:0:7097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784403184.484409:0:7097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784403184.484411:0:7097:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784403184.484412:0:7097:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784403184.484414:0:7097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784403184.484415:0:7097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784403184.484421:0:7097:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1784403184.484423:0:7097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784403184.484423:0:7097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784403184.484424:0:7097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784403184.484425:0:7097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784403184.484425:0:7097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784403184.484426:0:7097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784403184.484426:0:7097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784403184.484427:0:7097:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784403184.484428:0:7097:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784403184.484428:0:7097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784403184.484429:0:7097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784403184.484472:0:7097:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784403184.484511:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260796416:0@lo:253: 00000100:00100000:3.0:1784403184.485925:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.486005:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784403184.486115:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260796416 00000100:00100000:0.0:1784403184.486126:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260796416 00000100:00100000:0.0:1784403184.486203:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784403184.486217:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260796416:12345-0@lo:253: 20000000:01000000:0.0:1784403184.486264:0:6287:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784403184.486270:0:6287:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1784403184.486289:0:6287:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1784403184.486293:0:6287:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1784403184.487650:0:6287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784403184.487941:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1784403184.487958:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1784403184.488004:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1784403184.488012:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1784403184.488062:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1784403184.488119:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1784403184.488549:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1784403184.488573:0:6287:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:0.0:1784403184.488576:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:0.0:1784403184.488611:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1784403184.488619:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784403184.488668:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1784403184.488679:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:0.0:1784403184.488714:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1784403184.488724:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1784403184.488766:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1784403184.488816:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1784403184.495538:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1784403184.495593:0:6287:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:1.0:1784403184.495597:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:1.0:1784403184.497536:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1784403184.497573:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784403184.497673:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1784403184.497682:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:1.0:1784403184.497772:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1784403184.497783:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1784403184.497819:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1784403184.497855:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1784403184.497905:0:6287:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784403184.497909:0:6287:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784403184.497914:0:6287:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784403184.497934:0:6287:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784403184.497937:0:6287:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784403184.497996:0:6287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784403184.497999:0:6287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784403184.508555:0:7112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1784403184.509244:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1784403184.509379:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1784403184.509478:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1784403184.509495:0:6287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784403184.509509:0:6287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784403184.514098:0:7113:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1784403184.515679:0:7113:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1784403184.515833:0:7113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1784403184.516553:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1784403184.516601:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1784403184.516642:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1784403184.516654:0:6287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784403184.516657:0:6287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784403184.517291:0:7114:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1784403184.517349:0:7114:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1784403184.517394:0:7114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1784403184.517738:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1784403184.517772:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1784403184.517821:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1784403184.517835:0:6287:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1784403184.517838:0:6287:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1784403184.517849:0:6287:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784403184.517902:0:6287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.517925:0:6287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a40030200/0x6828175665afa3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa3e1 expref: 12 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.517943:0:6287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa3fd expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.517951:0:6287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a41671e00/0x6828175665afa474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa46d expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.517959:0:6287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.518009:0:6287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a41671e00/0x6828175665afa474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa46d expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.518023:0:6287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a41671e00/0x6828175665afa474 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa46d expref: 12 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.518040:0:6287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260796544:0@lo:104: 00000100:00100000:1.0:1784403184.518120:0:6287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784403184.518243:0:6287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa3fd expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.518252:0:6287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa404 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa3fd expref: 12 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.518261:0:6287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58090e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260796672:0@lo:104: 00000100:00100000:1.0:1784403184.518291:0:6287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.518748:0:6274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260796544 00000100:00100000:3.0:1784403184.518761:0:6274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260796544 00000100:00100000:2.0:1784403184.518762:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260796672 00000100:00100000:2.0:1784403184.518770:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260796672 00000100:00100000:3.0:1784403184.518824:0:6274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784403184.518836:0:6274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+4:6287:x1871082260796672:12345-0@lo:104: 00010000:00010000:3.0:1784403184.518852:0:6274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.518937:0:6274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784403184.518943:0:6274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+4:6287:x1871082260796672:12345-0@lo:104: Request processed in 110us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403184.518951:0:6274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784403184.518971:0:6274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784403184.518977:0:6274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+3:6287:x1871082260796544:12345-0@lo:104: 00010000:00010000:3.0:1784403184.518986:0:6274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519017:0:6274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784403184.519022:0:6274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+3:6287:x1871082260796544:12345-0@lo:104: Request processed in 46us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403184.519028:0:6274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1784403184.519045:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784403184.519051:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519070:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe000 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403184.519074:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519083:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa3fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403184.519090:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa3fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403184.519097:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784403184.519135:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa3fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519142:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403184.519171:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa3fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519179:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa3fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa404 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519196:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403184.519199:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519205:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ffc00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403184.519209:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519227:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa46d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403184.519234:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa46d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403184.519240:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784403184.519255:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa46d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519261:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403184.519267:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa46d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519286:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa46d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa474 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.519300:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403184.519302:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403184.519304:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403184.519318:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403184.519997:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260796928:0@lo:103: 00000100:00100000:2.0:1784403184.520149:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.521099:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260796928 00000100:00100000:3.0:1784403184.521116:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260796928 00010000:00010000:3.0:1784403184.521169:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a41671e00/0x6828175665afa474 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa46d expref: 13 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403184.521218:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784403184.521229:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+13:3566:x1871082260796928:12345-0@lo:103: 00010000:00010000:3.0:1784403184.521276:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403184.521283:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a41671e00/0x6828175665afa474 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa46d expref: 13 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.521306:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a41671e00/0x6828175665afa474 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa46d expref: 13 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.521332:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403184.521390:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+13:3566:x1871082260796928:12345-0@lo:103: Request processed in 163us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403184.521397:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1784403184.526375:0:6287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a40030200/0x6828175665afa3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa3e1 expref: 12 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.526404:0:6287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a40030200/0x6828175665afa3e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa3e1 expref: 12 pid: 6286 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.526444:0:6287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260797056:0@lo:104: 00000100:00100000:2.0:1784403184.526448:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260796928:0@lo:103: 00000100:00100000:2.0:1784403184.526488:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784403184.526511:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260796800:0@lo:103: 00000100:00100000:1.0:1784403184.526553:0:6287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403184.526563:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403184.526720:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260796800 00000100:00100000:0.0:1784403184.526729:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260796800 00010000:00010000:0.0:1784403184.526768:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa404 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa3fd expref: 13 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403184.526806:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784403184.526818:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+13:3566:x1871082260796800:12345-0@lo:103: 00010000:00010000:0.0:1784403184.526835:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403184.526842:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa404 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa3fd expref: 13 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.526854:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa404 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa3fd expref: 13 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.526903:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403184.527057:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260797056 00000100:00100000:3.0:1784403184.527062:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260797056 00000100:00100000:3.0:1784403184.527098:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784403184.527105:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:6287:x1871082260797056:12345-0@lo:104: 00010000:00010000:3.0:1784403184.527120:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.527205:0:6287:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9a80 going to sleep for 11 seconds 00010000:00010000:1.0:1784403184.527225:0:6287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41671e00/0x6828175665afa474 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa46d expref: 13 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.527239:0:6287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260796544:0@lo:104: 00010000:00010000:1.0:1784403184.527250:0:6287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa3fd expref: 12 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.527258:0:6287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58090e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260796672:0@lo:104: 00000100:00100000:0.0:1784403184.527432:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+11:3566:x1871082260796800:12345-0@lo:103: Request processed in 615us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403184.527442:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784403184.527472:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260796800:0@lo:103: 00010000:00010000:3.0:1784403184.527760:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784403184.527767:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:6287:x1871082260797056:12345-0@lo:104: Request processed in 663us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403184.527774:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1784403184.527840:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403184.527848:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.527857:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe600 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:0.0:1784403184.527862:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.527902:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa3e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784403184.527928:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa3e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403184.527934:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784403184.527981:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa3e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.527988:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784403184.528022:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa3e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.528029:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa3e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa3e8 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.528049:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403184.528051:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403184.528053:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403184.528604:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784403184.528625:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260797184:0@lo:103: 00000100:00100000:3.0:1784403184.528701:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403184.528803:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260797184 00000100:00100000:0.0:1784403184.528813:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260797184 00010000:00010000:0.0:1784403184.528847:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a40030200/0x6828175665afa3e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa3e1 expref: 11 pid: 6286 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403184.528909:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784403184.528919:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64472369-fee1-4bb4-a407-7797860a37a0+11:3568:x1871082260797184:12345-0@lo:103: 00010000:00010000:0.0:1784403184.528935:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403184.528940:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a40030200/0x6828175665afa3e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa3e1 expref: 11 pid: 6286 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.528952:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a40030200/0x6828175665afa3e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa3e1 expref: 11 pid: 6286 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.528991:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.529001:0:6278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.529019:0:6278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.529027:0:6278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.529034:0:6278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.529040:0:6278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.529046:0:6278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a41670400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403184.529051:0:6278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.529059:0:6278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.529068:0:6278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403184.529078:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403184.529124:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64472369-fee1-4bb4-a407-7797860a37a0+11:3568:x1871082260797184:12345-0@lo:103: Request processed in 206us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403184.529139:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784403184.529186:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260797184:0@lo:103: 00010000:00010000:1.0:1784403184.530369:0:6287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a40030200/0x6828175665afa3e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa3e1 expref: 10 pid: 6286 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.530391:0:6287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260797056:0@lo:104: 00010000:00010000:1.0:1784403184.530430:0:6287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.530443:0:6287:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.530449:0:6287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.530455:0:6287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41670400/0x6828175665afa4cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784403184.530479:0:6287:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784403184.610195:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+9:7097:x1871082260796416:12345-0@lo:253: Request processed in 123965us (124263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403184.610216:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784403184.610382:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260796416:0@lo:253: 10000000:01000000:3.0:1784403184.610402:0:7097:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784403184.610415:0:7097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784403184.610418:0:7097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784403184.610419:0:7097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784403184.610421:0:7097:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1784403184.610422:0:7097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784403184.610445:0:7097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784403184.610447:0:7097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784403184.610449:0:7097:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784403184.610451:0:7097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784403184.610452:0:7097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784403184.610481:0:7097:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c8a43036800 from lustre-OST0000 10000000:01000000:3.0:1784403184.610522:0:7097:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784403184.610527:0:7097:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784403184.610536:0:7097:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c8a526f8000 local copy 10000000:01000000:3.0:1784403184.610541:0:7097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784403184.610595:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.610608:0:7097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.610618:0:7097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403184.610642:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260797312:0@lo:101: 00000100:00100000:3.0:1784403184.610691:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.610761:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2f480 going to sleep for 11 seconds 00000100:00100000:1.0:1784403184.610910:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260797312 00000100:00100000:1.0:1784403184.610918:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260797312 00000100:00100000:1.0:1784403184.610966:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784403184.610977:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+9:7097:x1871082260797312:12345-0@lo:101: 00010000:00010000:1.0:1784403184.610993:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403184.611011:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a41670400/0x6828175665afa4dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa4d6 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.611038:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41670400/0x6828175665afa4dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa4d6 expref: 10 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.611050:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a41670400/0x6828175665afa4dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa4d6 expref: 10 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.611061:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a41670400, rc 0) 00000100:00100000:1.0:1784403184.611103:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+10:7097:x1871082260797312:12345-0@lo:101: Request processed in 128us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403184.611109:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784403184.611442:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260797312:0@lo:101: 00010000:00010000:3.0:1784403184.611462:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.611473:0:7097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403184.611660:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260797440:0@lo:501: 00000100:00100000:3.0:1784403184.611693:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.611736:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784403184.611852:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260797440 00000100:00100000:2.0:1784403184.611858:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260797440 00000100:00100000:2.0:1784403184.611936:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784403184.611945:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+10:7097:x1871082260797440:12345-0@lo:501: 00000100:00100000:2.0:1784403184.612253:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+10:7097:x1871082260797440:12345-0@lo:501: Request processed in 308us (558us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784403184.612262:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784403184.612571:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260797440:0@lo:501: 10000000:01000000:3.0:1784403184.612593:0:7097:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784403184.612632:0:7097:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784403184.612640:0:7097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.612651:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.612658:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.612685:0:7097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784403184.612711:0:7097:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c8a43036800 10000000:01000000:3.0:1784403184.612717:0:7097:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784403184.612722:0:7097:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c8a526f8000 10000000:01000000:3.0:1784403184.612725:0:7097:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784403184.612729:0:7097:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8c8a526f8000 from 1 10000000:01000000:3.0:1784403184.612732:0:7097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784403184.612763:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa4e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.612771:0:7097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa4e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.612781:0:7097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa4e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403184.612798:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260797568:0@lo:101: 00000100:00100000:3.0:1784403184.612846:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.612917:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1784403184.612978:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260797568 00000100:00100000:1.0:1784403184.612984:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260797568 00000100:00100000:1.0:1784403184.613023:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784403184.613033:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+10:7097:x1871082260797568:12345-0@lo:101: 00010000:00010000:1.0:1784403184.613044:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403184.613060:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a41671e00/0x6828175665afa4eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa4e4 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.613083:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41671e00/0x6828175665afa4eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa4e4 expref: 11 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.613094:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a41671e00/0x6828175665afa4eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa4e4 expref: 11 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.613111:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a41671e00, rc 0) 00000100:00100000:1.0:1784403184.613145:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260797568:12345-0@lo:101: Request processed in 114us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403184.613152:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1784403184.613238:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784403184.613246:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403184.613254:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ffc00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:2.0:1784403184.613259:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403184.613268:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784403184.613385:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403184.613393:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784403184.613477:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403184.613490:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784403184.613531:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403184.613539:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa4d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6828175665afa4dd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403184.613562:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403184.613564:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403184.613565:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403184.613575:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403184.613589:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260797696:0@lo:103: 00000100:00100000:2.0:1784403184.613621:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403184.613661:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260797696 00000100:00100000:2.0:1784403184.613665:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260797696 00000100:00100000:2.0:1784403184.613698:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403184.613704:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+11:3567:x1871082260797696:12345-0@lo:103: 00010000:00010000:2.0:1784403184.613715:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403184.613730:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41670400/0x6828175665afa4dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa4d6 expref: 11 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403184.613744:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403184.613770:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+10:3567:x1871082260797696:12345-0@lo:103: Request processed in 66us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403184.613776:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403184.613811:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260797696:0@lo:103: 00000100:00100000:3.0:1784403184.614084:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260797568:0@lo:101: 00010000:00010000:3.0:1784403184.614101:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa4e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa4eb expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.614110:0:7097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa4e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa4eb expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403184.614127:0:7097:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784403184.614145:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa4e4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa4eb expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.614152:0:7097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa4e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa4eb expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403184.614161:0:7097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784403184.614166:0:7097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784403184.614172:0:7097:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784403184.614174:0:7097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784403184.614192:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.614199:0:7097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.614206:0:7097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403184.614219:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260797824:0@lo:101: 00000100:00100000:3.0:1784403184.614271:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.614310:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1784403184.614680:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260797824 00000100:00100000:1.0:1784403184.614688:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260797824 00000100:00100000:1.0:1784403184.614765:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784403184.614774:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+10:7097:x1871082260797824:12345-0@lo:101: 00010000:00010000:1.0:1784403184.614787:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403184.614803:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a41671200/0x6828175665afa4f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa4f2 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.614824:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41671200/0x6828175665afa4f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa4f2 expref: 11 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.614835:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a41671200/0x6828175665afa4f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa4f2 expref: 11 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.614843:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a41671200, rc 0) 00000100:00100000:1.0:1784403184.614916:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260797824:12345-0@lo:101: Request processed in 143us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403184.614923:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784403184.615010:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260797824:0@lo:101: 00010000:00010000:3.0:1784403184.615026:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.615034:0:7097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403184.615166:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260797952:0@lo:501: 00000100:00100000:3.0:1784403184.615194:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.615525:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1784403184.615625:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260797952 00000100:00100000:2.0:1784403184.615645:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260797952 00000100:00100000:2.0:1784403184.615674:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784403184.615681:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260797952:12345-0@lo:501: 00000100:00100000:2.0:1784403184.616073:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260797952:12345-0@lo:501: Request processed in 390us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403184.616081:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784403184.616298:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260797952:0@lo:501: 00000100:00100000:3.0:1784403184.616343:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798080:0@lo:503: 00000100:00100000:3.0:1784403184.616388:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.616428:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1784403184.616632:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260798080 00000100:00100000:2.0:1784403184.616638:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260798080 00000100:00100000:2.0:1784403184.616660:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784403184.616667:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260798080:12345-0@lo:503: 00000100:00100000:2.0:1784403184.616863:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260798080:12345-0@lo:503: Request processed in 196us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403184.616901:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784403184.616992:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798080:0@lo:503: 00000040:00080000:3.0:1784403184.617591:0:7097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784403184.617677:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798208:0@lo:502: 00000100:00100000:3.0:1784403184.617737:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.617828:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1784403184.617921:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260798208 00000100:00100000:1.0:1784403184.617928:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260798208 00000100:00100000:0.0:1784403184.618026:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784403184.618038:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260798208:12345-0@lo:502: 00000100:00100000:0.0:1784403184.618257:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260798208:12345-0@lo:502: Request processed in 223us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403184.618265:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784403184.618371:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798208:0@lo:502: 00000040:00080000:3.0:1784403184.618697:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784403184.618764:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784403184.618798:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784403184.618847:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784403184.618932:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784403184.618969:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784403184.619006:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798336:0@lo:502: 00000100:00100000:3.0:1784403184.619056:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.623209:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1784403184.623405:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260798336 00000100:00100000:2.0:1784403184.623428:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260798336 00000100:00100000:2.0:1784403184.623491:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784403184.623513:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260798336:12345-0@lo:502: 00000100:00100000:2.0:1784403184.623926:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260798336:12345-0@lo:502: Request processed in 413us (4867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403184.623936:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784403184.624181:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798336:0@lo:502: 00000040:00080000:3.0:1784403184.626063:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784403184.626097:0:7097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1784403184.627525:0:7115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784403184.627542:0:7115:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1784403184.627553:0:7115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403184.627556:0:7115:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784403184.627562:0:7115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784403184.627585:0:7115:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c8a527a4d40) 00000020:00000080:3.0:1784403184.627634:0:7115:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784403184.627642:0:7115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784403184.627740:0:7115:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a43036800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784403184.627749:0:7115:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784403184.627758:0:7115:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6828175665afa507 00010000:00010000:2.0:1784403184.633142:0:7115:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1784403184.634219:0:7115:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1784403184.641586:0:7115:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1784403184.642090:0:7115:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1784403184.651838:0:7115:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784403184.652752:0:7115:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1784403184.654824:0:7115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784403184.654843:0:7115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403184.654853:0:7115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403184.654856:0:7115:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784403184.654861:0:7115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784403184.654901:0:7115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403184.654903:0:7115:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784403184.654907:0:7115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784403184.654909:0:7115:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784403184.654985:0:7115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403184.654989:0:7115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403184.654990:0:7115:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784403184.654994:0:7115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784403184.655265:0:7097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1784403184.655304:0:7097:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784403184.655330:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.655347:0:7097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403184.655356:0:7097:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a43036800 from 1 10000000:01000000:3.0:1784403184.655359:0:7097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784403184.655424:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.655454:0:7097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.655468:0:7097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403184.655514:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798464:0@lo:101: 00000100:00100000:3.0:1784403184.655619:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.655683:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403184.657453:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260798464 00000100:00100000:3.0:1784403184.657470:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260798464 00000100:00100000:3.0:1784403184.657559:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784403184.657573:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+11:7097:x1871082260798464:12345-0@lo:101: 00010000:00010000:3.0:1784403184.657598:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403184.657623:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a414ff600/0x6828175665afa515 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa50e expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.657663:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a414ff600/0x6828175665afa515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa50e expref: 12 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.657676:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a414ff600/0x6828175665afa515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa50e expref: 12 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.657685:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a414ff600, rc 0) 00000100:00100000:3.0:1784403184.657787:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260798464:12345-0@lo:101: Request processed in 216us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403184.657794:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784403184.657902:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798464:0@lo:101: 00010000:00010000:3.0:1784403184.657936:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.657947:0:7097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403184.658122:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798592:0@lo:501: 00000100:00100000:3.0:1784403184.658177:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.658212:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403184.658527:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260798592 00000100:00100000:0.0:1784403184.658534:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260798592 00000100:00100000:0.0:1784403184.658577:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784403184.658587:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260798592:12345-0@lo:501: 00000100:00100000:0.0:1784403184.658912:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260798592:12345-0@lo:501: Request processed in 326us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403184.658921:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784403184.659505:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798592:0@lo:501: 00000100:00100000:3.0:1784403184.659567:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798720:0@lo:503: 00000100:00100000:3.0:1784403184.659621:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.659663:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403184.660386:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260798720 00000100:00100000:0.0:1784403184.660403:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260798720 00000100:00100000:0.0:1784403184.660462:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784403184.660473:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260798720:12345-0@lo:503: 00000100:00100000:0.0:1784403184.660844:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260798720:12345-0@lo:503: Request processed in 371us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403184.660851:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784403184.660960:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798720:0@lo:503: 00000040:00080000:0.0:1784403184.666055:0:7097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784403184.666224:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798848:0@lo:502: 00000100:00100000:0.0:1784403184.666966:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403184.667047:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca4000 going to sleep for 11 seconds 00000100:00100000:2.0:1784403184.667519:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260798848 00000100:00100000:2.0:1784403184.667531:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260798848 00000100:00100000:2.0:1784403184.667637:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784403184.667649:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260798848:12345-0@lo:502: 00000100:00100000:2.0:1784403184.668248:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260798848:12345-0@lo:502: Request processed in 599us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403184.668258:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784403184.673887:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798848:0@lo:502: 00000040:00080000:1.0:1784403184.674912:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1784403184.675004:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1784403184.675073:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798976:0@lo:502: 00000100:00100000:1.0:1784403184.675180:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403184.675254:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403184.675403:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260798976 00000100:00100000:3.0:1784403184.675413:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260798976 00000100:00100000:3.0:1784403184.675483:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784403184.675507:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260798976:12345-0@lo:502: 00000100:00100000:3.0:1784403184.675779:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260798976:12345-0@lo:502: Request processed in 286us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403184.675788:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784403184.676130:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260798976:0@lo:502: 00000040:00080000:1.0:1784403184.676411:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1784403184.676429:0:7097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784403184.678787:0:7119:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784403184.678805:0:7119:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403184.678808:0:7119:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784403184.678817:0:7119:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a43036800 00000020:00000080:3.0:1784403184.678820:0:7119:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784403184.678848:0:7119:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784403184.678851:0:7119:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403184.678853:0:7119:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784403184.678899:0:7119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784403184.679166:0:7097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784403184.679198:0:7097:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784403184.679384:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.679400:0:7097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403184.679454:0:7097:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784403184.679458:0:7097:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c8a43036800 10000000:01000000:1.0:1784403184.679462:0:7097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c8a43036800 10000000:01000000:1.0:1784403184.679467:0:7097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784403184.679473:0:7097:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a43036800 from 1 10000000:01000000:1.0:1784403184.679476:0:7097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784403184.679538:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.679548:0:7097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.679572:0:7097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.679607:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260799104:0@lo:101: 00000100:00100000:1.0:1784403184.679717:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403184.679778:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403184.679898:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260799104 00000100:00100000:2.0:1784403184.679907:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260799104 00000100:00100000:2.0:1784403184.679963:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784403184.679975:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260799104:12345-0@lo:101: 00010000:00010000:2.0:1784403184.679994:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403184.680010:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a5b67aa00/0x6828175665afa523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa51c expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403184.680040:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a5b67aa00/0x6828175665afa523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa51c expref: 13 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403184.680052:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a5b67aa00/0x6828175665afa523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa51c expref: 13 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403184.680062:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a5b67aa00, rc 0) 00000100:00100000:2.0:1784403184.680118:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:7097:x1871082260799104:12345-0@lo:101: Request processed in 145us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403184.680125:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784403184.680590:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260799104:0@lo:101: 00010000:00010000:1.0:1784403184.680612:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.680625:0:7097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.680748:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260799232:0@lo:501: 00000100:00100000:1.0:1784403184.680781:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403184.680821:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403184.680941:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260799232 00000100:00100000:2.0:1784403184.680946:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260799232 00000100:00100000:2.0:1784403184.681016:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784403184.681025:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7097:x1871082260799232:12345-0@lo:501: 00000100:00100000:2.0:1784403184.681401:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7097:x1871082260799232:12345-0@lo:501: Request processed in 376us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403184.681415:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784403184.681640:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260799232:0@lo:501: 00000100:00100000:1.0:1784403184.681682:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260799360:0@lo:503: 00000100:00100000:1.0:1784403184.681726:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403184.681980:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784403184.682099:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260799360 00000100:00100000:3.0:1784403184.682106:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260799360 00000100:00100000:3.0:1784403184.682140:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784403184.682148:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:7097:x1871082260799360:12345-0@lo:503: 00000100:00100000:3.0:1784403184.682477:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:7097:x1871082260799360:12345-0@lo:503: Request processed in 328us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403184.682486:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784403184.682608:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260799360:0@lo:503: 00000040:00080000:1.0:1784403184.683075:0:7097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784403184.683170:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260799488:0@lo:502: 00000100:00100000:1.0:1784403184.683219:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403184.683264:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403184.683688:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260799488 00000100:00100000:2.0:1784403184.683697:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260799488 00000100:00100000:2.0:1784403184.683757:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784403184.683767:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7097:x1871082260799488:12345-0@lo:502: 00000100:00100000:2.0:1784403184.684067:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7097:x1871082260799488:12345-0@lo:502: Request processed in 300us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403184.684075:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784403184.684416:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260799488:0@lo:502: 00000040:00080000:1.0:1784403184.684783:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784403184.684847:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784403184.684932:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784403184.684988:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784403184.685035:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784403184.685083:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784403184.685112:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784403184.685139:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784403184.685181:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784403184.685217:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784403184.685565:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784403184.685613:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784403184.685642:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784403184.685667:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784403184.685705:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784403184.685733:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784403184.685758:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784403184.685796:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784403184.685823:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784403184.685852:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784403184.685933:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784403184.685968:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784403184.686002:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784403184.686048:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784403184.686083:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1784403184.686115:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1784403184.686180:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1784403184.686214:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1784403184.687394:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260799616:0@lo:502: 00000100:00100000:1.0:1784403184.687509:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403184.687560:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403184.687643:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260799616 00000100:00100000:2.0:1784403184.687662:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260799616 00000100:00100000:2.0:1784403184.687722:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784403184.687731:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7097:x1871082260799616:12345-0@lo:502: 00000100:00100000:2.0:1784403184.688025:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7097:x1871082260799616:12345-0@lo:502: Request processed in 293us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403184.688033:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784403184.688098:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260799616:0@lo:502: 00000040:00080000:2.0:1784403184.688227:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1784403184.688246:0:7097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1784403184.689690:0:7120:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784403184.689729:0:7120:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c8a7fd2cd40) 00000020:00000080:0.0:1784403184.689758:0:7120:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1784403184.690197:0:7120:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a43036800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784403184.690203:0:7120:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c8a43036800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784403184.690206:0:7120:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a43036800 3 00010000:00080000:0.0:1784403184.690259:0:7120:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c8a75f94000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.128@tcp at head 00010000:00010000:0.0:1784403184.693165:0:7120:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1784403184.694566:0:7120:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1784403184.694642:0:7120:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784403184.694660:0:7120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6828175665afa531 00000100:00080000:0.0:1784403184.694676:0:7120:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784403184.694684:0:7120:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c8a75f94000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1784403184.694737:0:7120:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a4302f800 x1871082260799744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784403184.694830:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3564:1871082260799744:0@lo:38: 00000100:00100000:1.0:1784403184.694950:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784403184.695046:0:7120:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784403184.695112:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260799872:0@lo:400: 00000100:00100000:0.0:1784403184.695149:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403184.695195:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260799744 00000100:00100000:0.0:1784403184.695203:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260799744 00000100:00100000:0.0:1784403184.695241:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260799872 00000100:00100000:0.0:1784403184.695243:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260799872 00000100:00100000:0.0:1784403184.695270:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784403184.695347:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260799872:12345-0@lo:400: 00000100:00100000:0.0:1784403184.695405:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260799872:12345-0@lo:400: Request processed in 60us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403184.695412:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784403184.695430:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784403184.695434:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3564:x1871082260799744:12345-0@lo:38: 00010000:00080000:0.0:1784403184.695457:0:6292:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1784403184.695502:0:6292:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6828175665afa538 00000004:00100000:0.0:1784403184.695522:0:6292:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784403184.695562:0:6292:0:(import.c:65:import_set_state_nolock()) ffff8c8a75f92000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784403184.698753:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3564:x1871082260799744:12345-0@lo:38: Request processed in 3298us (3784us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403184.698771:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784403184.699150:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c8a4302d880 x1871082260799872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403184.699236:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260799872:0@lo:400: 00000040:00080000:2.0:1784403184.700752:0:7120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1784403184.700932:0:7097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1784403184.700962:0:7097:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784403184.700986:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403184.701000:0:7097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784403184.701065:0:7097:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784403184.701068:0:7097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784403184.701070:0:7097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403184.701071:0:7097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403184.701073:0:7097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403184.701074:0:7097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403184.701076:0:7097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403184.701078:0:7097:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784403184.701079:0:7097:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784403184.701081:0:7097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403184.701083:0:7097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784403184.701088:0:7097:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1784403184.701090:0:7097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784403184.701092:0:7097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784403184.701093:0:7097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403184.701094:0:7097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403184.701095:0:7097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403184.701096:0:7097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403184.701097:0:7097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403184.701098:0:7097:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784403184.701100:0:7097:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784403184.701100:0:7097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403184.701102:0:7097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784403184.701138:0:7097:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784403184.701162:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48970380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260800000:0@lo:253: 00000100:00100000:2.0:1784403184.701397:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403184.701450:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260800000 00000100:00100000:2.0:1784403184.701459:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260800000 00000100:00100000:2.0:1784403184.701525:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784403184.701537:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7097:x1871082260800000:12345-0@lo:253: 20000000:01000000:2.0:1784403184.701592:0:6287:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784403184.701612:0:6287:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1784403184.702770:0:3564:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c8a4302f800 x1871082260799744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784403194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403184.702803:0:3564:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784403184.702817:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1784403184.702828:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784403184.702834:0:3564:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784403184.702838:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a75f94000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784403184.702848:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3564:1871082260799744:0@lo:38: 00000100:00100000:3.0:1784403184.703057:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cf73480 going to sleep for 11 seconds 20000000:01000000:3.0:1784403184.730030:0:6287:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784403184.730056:0:6287:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784403184.730131:0:6308:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784403184.730139:0:6308:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784403184.730173:0:6308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.730198:0:6308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a41671000/0x6828175665afa49e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa497 expref: 13 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.730208:0:6308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.730285:0:6308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a41671000/0x6828175665afa49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa497 expref: 13 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403184.730304:0:6308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a41671000/0x6828175665afa49e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa497 expref: 13 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.730326:0:6308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6308:1871082260800128:0@lo:104: 00000100:00100000:1.0:1784403184.730434:0:6308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403184.730510:0:6308:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784403184.730678:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260800128 00000100:00100000:3.0:1784403184.730688:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260800128 00000100:00100000:3.0:1784403184.730762:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784403184.730775:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:6308:x1871082260800128:12345-0@lo:104: 00010000:00010000:3.0:1784403184.730793:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a40031400/0x6828175665afa497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.730894:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784403184.730902:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:6308:x1871082260800128:12345-0@lo:104: Request processed in 129us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403184.730910:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1784403184.730935:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403184.730942:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a40031400/0x6828175665afa497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.730951:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40031400 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403184.730955:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a40031400/0x6828175665afa497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.730988:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a40031400/0x6828175665afa497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403184.730996:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a40031400/0x6828175665afa497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403184.731003:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784403184.731043:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a40031400/0x6828175665afa497 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731050:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403184.731075:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a40031400/0x6828175665afa497 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731083:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a40031400/0x6828175665afa497 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa49e expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731107:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403184.731109:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403184.731110:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403184.731134:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260800256:0@lo:103: 00000100:00100000:3.0:1784403184.731174:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403184.731217:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260800256 00000100:00100000:3.0:1784403184.731234:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260800256 00010000:00010000:3.0:1784403184.731253:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a41671000/0x6828175665afa49e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa497 expref: 14 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403184.731402:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784403184.731411:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42d03850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+14:3566:x1871082260800256:12345-0@lo:103: 00010000:00010000:3.0:1784403184.731431:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403184.731438:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a41671000/0x6828175665afa49e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa497 expref: 14 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731448:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a41671000/0x6828175665afa49e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa497 expref: 14 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731468:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731476:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784403184.731503:0:6277:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003004581s 00010000:00010000:3.0:1784403184.731509:0:6277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731516:0:6277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731523:0:6277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731528:0:6277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731533:0:6277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a41670e00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403184.731538:0:6277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731545:0:6277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731561:0:6277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731573:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403184.731605:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42d03850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+14:3566:x1871082260800256:12345-0@lo:103: Request processed in 196us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403184.731612:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784403184.731691:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260800256:0@lo:103: 00010000:00010000:3.0:1784403184.731724:0:6308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41671000/0x6828175665afa49e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa497 expref: 13 pid: 6287 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403184.731736:0:6308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6308:1871082260800128:0@lo:104: 00010000:00010000:3.0:1784403184.731751:0:6308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731761:0:6308:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731767:0:6308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403184.731773:0:6308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41670e00/0x6828175665afa53f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403184.759207:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:7097:x1871082260800000:12345-0@lo:253: Request processed in 57658us (57796us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403184.759259:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784403184.759490:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48970380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7097:1871082260800000:0@lo:253: 10000000:01000000:3.0:1784403184.759527:0:7097:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784403184.759531:0:7097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784403184.759533:0:7097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784403184.759542:0:7097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784403184.759543:0:7097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784403184.759544:0:7097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784403184.759546:0:7097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784403184.759547:0:7097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784403184.759549:0:7097:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784403184.759550:0:7097:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784403184.759552:0:7097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784403184.759554:0:7097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784403184.759576:0:7097:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784403184.773930:0:7097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403184.775651:0:7097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784403184.775965:0:7097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403184.776175:0:7097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784403184.777765:0:7097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403184.778421:0:7097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784403184.779793:0:7097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1784403185.110941:0:7097:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784403185.110951:0:7097:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784403185.111134:0:7097:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784403185.111213:0:7097:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784403185.111239:0:7097:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784403185.111360:0:7097:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1784403185.505111:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403186.528354:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403187.552009:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784403188.382994:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784403188.383008:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a5270b000 from 21 10000000:01000000:3.0:1784403188.383015:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784403188.383075:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.383089:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.383105:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403188.383139:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260800384:0@lo:101: 00000100:00100000:3.0:1784403188.383256:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.383329:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7ae0ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403188.383571:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260800384 00000100:00100000:2.0:1784403188.383583:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260800384 00000100:00100000:2.0:1784403188.383669:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784403188.383683:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:6290:x1871082260800384:12345-0@lo:101: 00010000:00010000:2.0:1784403188.383863:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403188.383902:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa54d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa546 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403188.383935:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa546 expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403188.383953:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa546 expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403188.383963:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a5b67a400, rc 0) 00000100:00100000:2.0:1784403188.384025:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260800384:12345-0@lo:101: Request processed in 345us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403188.384032:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784403188.384143:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260800384:0@lo:101: 00010000:00010000:3.0:1784403188.384172:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.384183:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403188.384285:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260800512:0@lo:501: 00000100:00100000:3.0:1784403188.384315:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.384345:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7ae0ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403188.384752:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260800512 00000100:00100000:2.0:1784403188.384759:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260800512 00000100:00100000:2.0:1784403188.384801:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784403188.384810:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260800512:12345-0@lo:501: 00000100:00100000:2.0:1784403188.385531:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260800512:12345-0@lo:501: Request processed in 718us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403188.385559:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784403188.385827:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260800512:0@lo:501: 00000100:00100000:3.0:1784403188.386116:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260800640:0@lo:503: 00000100:00100000:3.0:1784403188.386298:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.386378:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7ae0ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403188.386419:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260800640 00000100:00100000:2.0:1784403188.386435:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260800640 00000100:00100000:2.0:1784403188.386513:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784403188.386524:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260800640:12345-0@lo:503: 00000100:00100000:1.0:1784403188.387627:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260800640:12345-0@lo:503: Request processed in 1097us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403188.387650:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784403188.388017:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260800640:0@lo:503: 00000100:00100000:1.0:1784403188.388531:0:7272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:7272:1871082260800768:0@lo:502: 00000100:00100000:1.0:1784403188.389192:0:7272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403188.389329:0:7272:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a5856d600 going to sleep for 11 seconds 00000100:00100000:3.0:1784403188.389481:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260800768 00000100:00100000:3.0:1784403188.389492:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260800768 00000100:00100000:3.0:1784403188.389633:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784403188.389655:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7272:x1871082260800768:12345-0@lo:502: 00000100:00100000:3.0:1784403188.390421:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7272:x1871082260800768:12345-0@lo:502: Request processed in 774us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403188.390440:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784403188.390573:0:7272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:7272:1871082260800768:0@lo:502: 00000100:00100000:1.0:1784403188.390660:0:7272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:7272:1871082260800896:0@lo:502: 00000100:00100000:1.0:1784403188.390715:0:7272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403188.391116:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260800896 00000100:00100000:2.0:1784403188.391124:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260800896 00000100:00100000:2.0:1784403188.391159:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784403188.391180:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:7272:x1871082260800896:12345-0@lo:502: 00000100:00100000:2.0:1784403188.391378:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:7272:x1871082260800896:12345-0@lo:502: Request processed in 200us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403188.391386:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784403188.391789:0:7272:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a5856d600 going to sleep for 11 seconds 00000100:00100000:1.0:1784403188.391815:0:7272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:7272:1871082260800896:0@lo:502: 00000040:00080000:1.0:1784403188.391848:0:7272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1784403188.392283:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1784403188.392306:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784403188.392320:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.392334:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403188.392345:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784403188.392349:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c8a5270b000 from 4 10000000:01000000:3.0:1784403188.392362:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784403188.392404:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.392412:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.392433:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403188.392455:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260801024:0@lo:101: 00000100:00100000:3.0:1784403188.392507:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.392826:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7ae0a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784403188.393003:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260801024 00000100:00100000:1.0:1784403188.393011:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260801024 00000100:00100000:1.0:1784403188.393084:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784403188.393095:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260801024:12345-0@lo:101: 00010000:00010000:1.0:1784403188.393110:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403188.393127:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a41670800/0x6828175665afa55b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa554 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403188.393155:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41670800/0x6828175665afa55b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa554 expref: 14 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403188.393177:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a41670800/0x6828175665afa55b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa554 expref: 14 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403188.393200:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a41670800, rc 0) 00000100:00100000:1.0:1784403188.393266:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260801024:12345-0@lo:101: Request processed in 171us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403188.393272:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784403188.393471:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260801024:0@lo:101: 00010000:00010000:2.0:1784403188.393491:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403188.393502:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403188.393582:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260801152:0@lo:256: 00000100:00100000:2.0:1784403188.393618:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403188.394409:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d56cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403188.394465:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260801152 00000100:00100000:3.0:1784403188.394473:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260801152 00000100:00100000:3.0:1784403188.394515:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784403188.394524:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260801152:12345-0@lo:256: 20000000:01000000:3.0:1784403188.394619:0:6287:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784403188.394639:0:6287:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784403188.394784:0:6287:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1784403188.395090:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260801152:12345-0@lo:256: Request processed in 566us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403188.395098:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784403188.395357:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260801152:0@lo:256: 10000000:01000000:2.0:1784403188.395420:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784403188.395441:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403188.395463:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403188.395473:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784403188.395475:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1784403188.395479:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784403188.395515:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403188.395523:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403188.395532:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403188.395632:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260801280:0@lo:101: 00000100:00100000:2.0:1784403188.395820:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403188.395920:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d56cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403188.396138:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260801280 00000100:00100000:3.0:1784403188.396145:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260801280 00000100:00100000:3.0:1784403188.396363:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784403188.396373:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260801280:12345-0@lo:101: 00010000:00010000:3.0:1784403188.396389:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403188.396405:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a414fe800/0x6828175665afa569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa562 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.396450:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a414fe800/0x6828175665afa569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa562 expref: 15 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.396463:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a414fe800/0x6828175665afa569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa562 expref: 15 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.396472:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a414fe800, rc 0) 00000100:00100000:3.0:1784403188.396628:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260801280:12345-0@lo:101: Request processed in 256us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403188.396635:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784403188.396846:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260801280:0@lo:101: 00010000:00010000:2.0:1784403188.396891:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403188.396902:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403188.396981:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260801408:0@lo:501: 00000100:00100000:2.0:1784403188.397013:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403188.397049:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d56cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403188.397118:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260801408 00000100:00100000:1.0:1784403188.397125:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260801408 00000100:00100000:1.0:1784403188.397172:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784403188.397181:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260801408:12345-0@lo:501: 00000100:00100000:1.0:1784403188.397845:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260801408:12345-0@lo:501: Request processed in 664us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403188.397854:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784403188.397925:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260801408:0@lo:501: 00000100:00100000:1.0:1784403188.397964:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260801536:0@lo:503: 00000100:00100000:1.0:1784403188.398000:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403188.398016:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a5856dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403188.398028:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260801536 00000100:00100000:1.0:1784403188.398032:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260801536 00000100:00100000:1.0:1784403188.398050:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784403188.398057:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260801536:12345-0@lo:503: 00000100:00100000:1.0:1784403188.399132:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260801536:12345-0@lo:503: Request processed in 1067us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403188.399142:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784403188.399338:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260801536:0@lo:503: 00000100:00100000:3.0:1784403188.400125:0:7273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:7273:1871082260801664:0@lo:502: 00000100:00100000:3.0:1784403188.400319:0:7273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.400400:0:7273:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7ae0a180 going to sleep for 11 seconds 00000100:00100000:2.0:1784403188.400450:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260801664 00000100:00100000:2.0:1784403188.400459:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260801664 00000100:00100000:2.0:1784403188.400614:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784403188.400626:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:7273:x1871082260801664:12345-0@lo:502: 00000100:00100000:2.0:1784403188.401072:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:7273:x1871082260801664:12345-0@lo:502: Request processed in 446us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403188.401081:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784403188.401214:0:7273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:7273:1871082260801664:0@lo:502: 00000020:01000000:1.0:1784403188.401253:0:7273:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784403188.401268:0:7273:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784403188.401277:0:7273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403188.401279:0:7273:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784403188.401285:0:7273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784403188.401290:0:7273:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.128@tcp to nid 0x20000c0a8cc80 (192.168.204.128@tcp) 00000020:01000000:1.0:1784403188.401320:0:7273:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784403188.401324:0:7273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784403188.401341:0:7273:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c8a58098000) 00000020:00000080:1.0:1784403188.401367:0:7273:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784403188.401374:0:7273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784403188.401469:0:7273:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784403188.401477:0:7273:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784403188.401484:0:7273:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afa577 00010000:00080000:1.0:1784403188.401524:0:7273:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c8a7ddc5800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:1.0:1784403188.401996:0:7273:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1784403188.496752:0:7273:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784403188.496785:0:7273:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784403188.498437:0:7273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784403188.499224:0:7273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784403188.499385:0:7273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1784403188.499549:0:7273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1784403188.500767:0:7279:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403188.500775:0:7279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784403188.506164:0:7273:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784403188.506189:0:7273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784403188.506243:0:7273:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784403188.506273:0:7273:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6828175665afa57e 00000100:00080000:3.0:1784403188.506289:0:7273:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784403188.506296:0:7273:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c8a7ddc5800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1784403188.506349:0:7273:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a81b5aa00 x1871082260801792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784403188.506379:0:7273:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1784403188.506505:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260801792:0@lo:8: 00000100:00100000:0.0:1784403188.506616:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403188.507041:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260801920:0@lo:400: 00000100:00100000:3.0:1784403188.507067:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260802176:0@lo:400: 00000100:00100000:2.0:1784403188.507084:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.507104:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403188.507114:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403188.507120:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260802048:0@lo:400: 00000100:00100000:2.0:1784403188.507143:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403188.507174:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260802176 00000100:00100000:2.0:1784403188.507181:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260802176 00000020:01000000:3.0:1784403188.507210:0:7273:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784403188.507215:0:7273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403188.507233:0:7273:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784403188.507237:0:7273:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1784403188.507237:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260802048 00000100:00100000:2.0:1784403188.507240:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260802048 00000020:00000080:3.0:1784403188.507243:0:7273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403188.507244:0:7273:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784403188.507247:0:7273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784403188.507248:0:7273:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784403188.507258:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784403188.507268:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260802176:12345-0@lo:400: 00000100:00100000:3.0:1784403188.507273:0:7273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:7273:1871082260802304:0@lo:502: 00000100:00100000:3.0:1784403188.507311:0:7273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403188.507324:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260802176:12345-0@lo:400: Request processed in 58us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403188.507332:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260801920 00000100:00100000:2.0:1784403188.507332:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784403188.507335:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260801920 00000100:00100000:2.0:1784403188.507351:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784403188.507356:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260802304 00000100:00100000:2.0:1784403188.507357:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260802048:12345-0@lo:400: 00000100:00100000:3.0:1784403188.507358:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260802304 00000100:00100000:3.0:1784403188.507368:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784403188.507373:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49cf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:3567:x1871082260801920:12345-0@lo:400: 00000100:00100000:2.0:1784403188.507386:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260802048:12345-0@lo:400: Request processed in 30us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403188.507397:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49cf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:3567:x1871082260801920:12345-0@lo:400: Request processed in 24us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403188.507403:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784403188.507437:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784403188.507444:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49cf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+15:7273:x1871082260802304:12345-0@lo:502: 00000100:00100000:2.0:1784403188.507542:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784403188.507652:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260801792 00000100:00100000:1.0:1784403188.507657:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260801792 00000100:00100000:1.0:1784403188.507681:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784403188.507697:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260801792:12345-0@lo:8: 00010000:00080000:1.0:1784403188.507723:0:7099:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1784403188.507758:0:7099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6828175665afa585 00000100:00080000:2.0:1784403188.507761:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784403188.507799:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b5ad80 x1871082260802048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00100000:1.0:1784403188.507802:0:7099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c8a736a6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784403188.507807:0:7099:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1784403188.507811:0:7099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1784403188.507813:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260802048:0@lo:400: 00000100:00100000:2.0:1784403188.507822:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260801920:0@lo:400: 00010000:00080000:2.0:1784403188.507857:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b59500 x1871082260802176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403188.507940:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260802176:0@lo:400: 00002000:00100000:1.0:1784403188.508044:0:7099:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784403188.508181:0:7099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784403188.508208:0:7099:0:(import.c:65:import_set_state_nolock()) ffff8c8a736a0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784403188.508261:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3564:x1871082260801792:12345-0@lo:8: Request processed in 564us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403188.508277:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784403188.508298:0:3564:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b5aa00 x1871082260801792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784403198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403188.508308:0:3564:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784403188.508316:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784403188.508324:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784403188.508329:0:3564:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784403188.508331:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a7ddc5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784403188.508350:0:3564:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784403188.508354:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260801792:0@lo:8: 00000004:00080000:2.0:1784403188.508549:0:7279:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784403188.508803:0:7279:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 194076936414ns, next at 0ns, rc = 0 00000100:00100000:3.0:1784403188.508948:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49cf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+15:7273:x1871082260802304:12345-0@lo:502: Request processed in 1502us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403188.508957:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784403188.509014:0:7273:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca6840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403188.509030:0:7273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:7273:1871082260802304:0@lo:502: 00000020:01000000:3.0:1784403188.509059:0:7273:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784403188.509067:0:7273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403188.509069:0:7273:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784403188.509075:0:7273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1784403188.510801:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1784403188.510846:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784403188.510862:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.510893:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403188.510906:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784403188.510909:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c8a526f8000 from 1 10000000:01000000:3.0:1784403188.510913:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784403188.510981:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.510991:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.511005:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403188.511034:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260802432:0@lo:101: 00000100:00100000:3.0:1784403188.511122:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.511173:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca6840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403188.511198:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260802432 00000100:00100000:3.0:1784403188.511207:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260802432 00000100:00100000:3.0:1784403188.511259:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784403188.511269:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260802432:12345-0@lo:101: 00010000:00010000:3.0:1784403188.511283:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403188.511300:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6800/0x6828175665afa593 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa58c expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.511345:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6800/0x6828175665afa593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa58c expref: 16 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.511357:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6800/0x6828175665afa593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa58c expref: 16 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.511367:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6800, rc 0) 00000100:00100000:3.0:1784403188.511411:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260802432:12345-0@lo:101: Request processed in 143us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403188.511418:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784403188.517314:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260802432:0@lo:101: 00010000:00010000:3.0:1784403188.517357:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.517374:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403188.518406:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260802560:0@lo:501: 00000100:00100000:3.0:1784403188.518505:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.518634:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca6840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403188.518660:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260802560 00000100:00100000:3.0:1784403188.518669:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260802560 00000100:00100000:3.0:1784403188.518800:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784403188.518812:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260802560:12345-0@lo:501: 00000100:00100000:3.0:1784403188.519132:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260802560:12345-0@lo:501: Request processed in 320us (624us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784403188.519141:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784403188.520059:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260802560:0@lo:501: 10000000:01000000:3.0:1784403188.520108:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784403188.520121:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403188.520133:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784403188.543221:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1784403188.580722:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784403188.596757:0:7280:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1784403188.596853:0:7280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7280:1871082260802816:0@lo:7: 00000100:00100000:3.0:1784403188.596994:0:7280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.597062:0:7280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9300 going to sleep for 11 seconds 00000100:00100000:3.0:1784403188.597083:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260802688:0@lo:13: 00000100:00100000:3.0:1784403188.597111:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.597169:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260802816 00000100:00100000:3.0:1784403188.597179:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260802816 00000100:00100000:3.0:1784403188.597265:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784403188.597277:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7280:x1871082260802816:12345-0@lo:7: 00000100:00080000:1.0:1784403188.600029:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403188.600087:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260802688 00000100:00100000:1.0:1784403188.600102:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260802688 00000100:00100000:1.0:1784403188.600219:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784403188.600233:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3566:x1871082260802688:12345-0@lo:13: 00002000:00000024:1.0:1784403188.600282:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1784403188.600406:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3566:x1871082260802688:12345-0@lo:13: Request processed in 175us (3291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403188.600416:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784403188.602938:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b58000 x1871082260802688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403188.602977:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260802688:0@lo:13: 00002000:00080000:3.0:1784403188.606355:0:7102:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1784403188.606368:0:7102:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1784403188.606619:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7280:x1871082260802816:12345-0@lo:7: Request processed in 9334us (9615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403188.606645:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784403188.606847:0:7280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b5b480 x1871082260802816/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784403204 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403188.607017:0:7280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7280:1871082260802816:0@lo:7: 00000004:00080000:0.0:1784403188.607037:0:7280:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1784403188.607178:0:7280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7280:1871082260802944:0@lo:5: 00000100:00100000:3.0:1784403188.607224:0:7280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.607316:0:7280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784403188.607366:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260802944 00000100:00100000:1.0:1784403188.607376:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260802944 00000100:00100000:1.0:1784403188.607477:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784403188.607489:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7280:x1871082260802944:12345-0@lo:5: 00002000:00080000:1.0:1784403188.607529:0:7101:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1784403188.607535:0:7101:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1784403188.608152:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7280:x1871082260802944:12345-0@lo:5: Request processed in 662us (924us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784403188.608162:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784403188.608231:0:7280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b58000 x1871082260802944/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784403204 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403188.608246:0:7280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7280:1871082260802944:0@lo:5: 00000004:00080000:0.0:1784403188.608269:0:7280:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784403188.608309:0:7280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7280:1871082260803072:0@lo:700: 00000100:00100000:0.0:1784403188.608388:0:7280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403188.608412:0:7280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a52206a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784403188.608448:0:7108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260803072 00000100:00100000:0.0:1784403188.608453:0:7108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260803072 00000100:00100000:0.0:1784403188.608508:0:7108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784403188.608518:0:7108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7280:x1871082260803072:12345-0@lo:700: 00000100:00100000:0.0:1784403188.608551:0:7108:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:7108:1871082260803200:0@lo:700: 00000100:00100000:0.0:1784403188.608587:0:7108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403188.608605:0:7108:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a52206600 going to sleep for 11 seconds 00000100:00100000:0.0:1784403188.608639:0:6299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260803200 00000100:00100000:0.0:1784403188.608644:0:6299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260803200 00000100:00100000:0.0:1784403188.608672:0:6299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784403188.608678:0:6299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:7108:x1871082260803200:12345-0@lo:700: 40000000:02000000:0.0:1784403188.666410:0:6299:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1784403188.675370:0:6299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:7108:x1871082260803200:12345-0@lo:700: Request processed in 66677us (66767us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403188.675389:0:6299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784403188.680902:0:7108:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a4302d180 x1871082260803200/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784403204 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403188.680929:0:7108:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:7108:1871082260803200:0@lo:700: 40000000:02000000:1.0:1784403188.680950:0:7108:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1784403188.732347:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1784403188.732367:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784403188.732667:0:7108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7280:x1871082260803072:12345-0@lo:700: Request processed in 124143us (124270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403188.732683:0:7108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784403188.732784:0:7280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a4302dc00 x1871082260803072/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784403204 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403188.732799:0:7280:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784403188.732822:0:7280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7280:1871082260803072:0@lo:700: 00000004:02000040:3.0:1784403188.765749:0:7280:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1784403188.771187:0:7280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7280:1871082260803328:0@lo:5: 00000100:00100000:3.0:1784403188.771441:0:7280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403188.771704:0:7280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4315f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403188.771762:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260803328 00000100:00100000:1.0:1784403188.771773:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260803328 00000100:00100000:1.0:1784403188.771849:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784403188.771861:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7280:x1871082260803328:12345-0@lo:5: 00002000:00080000:1.0:1784403188.778160:0:7102:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1784403188.778188:0:7102:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1784403188.782489:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7280:x1871082260803328:12345-0@lo:5: Request processed in 10618us (11037us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784403188.782507:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784403188.782602:0:7280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b58000 x1871082260803328/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784403204 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403188.782625:0:7280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7280:1871082260803328:0@lo:5: 00000004:00080000:3.0:1784403188.782644:0:7280:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1784403189.599779:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403190.624394:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403191.650540:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403192.676425:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784403193.056712:0:7468:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1784403193.568136:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260803456:0@lo:400: 00000100:00100000:2.0:1784403193.568245:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403193.568425:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260803456 00000100:00100000:1.0:1784403193.568436:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260803456 00000100:00100000:1.0:1784403193.568513:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784403193.568524:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:3567:x1871082260803456:12345-0@lo:400: 00000100:00100000:1.0:1784403193.573313:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:3567:x1871082260803456:12345-0@lo:400: Request processed in 4773us (5050us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403193.573346:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784403193.575277:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260803584:0@lo:400: 00000100:00100000:1.0:1784403193.575380:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403193.575467:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260803584 00000100:00100000:1.0:1784403193.575477:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260803584 00000100:00100000:1.0:1784403193.575538:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784403193.575563:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260803584:12345-0@lo:400: 00000100:00100000:1.0:1784403193.575630:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260803584:12345-0@lo:400: Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403193.575638:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1784403193.575689:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a4302ea00 x1871082260803584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403193.575705:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260803584:0@lo:400: 00000100:00100000:2.0:1784403193.576249:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260803456:0@lo:400: 00000100:00100000:2.0:1784403193.577737:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260803712:0@lo:400: 00000100:00100000:2.0:1784403193.577823:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403193.578393:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260803712 00000100:00100000:1.0:1784403193.578415:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260803712 00000100:00100000:1.0:1784403193.578486:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403193.578498:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260803712:12345-0@lo:400: 00000100:00100000:1.0:1784403193.582920:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260803712:12345-0@lo:400: Request processed in 4409us (5081us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403193.582939:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1784403193.582990:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403193.583096:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260803840:0@lo:400: 00000100:00100000:0.0:1784403193.583192:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403193.583405:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260803840 00000100:00100000:1.0:1784403193.583417:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260803840 00000100:00100000:1.0:1784403193.583487:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784403193.583500:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3566:x1871082260803840:12345-0@lo:400: 00000100:00100000:1.0:1784403193.583578:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3566:x1871082260803840:12345-0@lo:400: Request processed in 82us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403193.583585:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784403193.583637:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a4302ed80 x1871082260803840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403193.583655:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260803840:0@lo:400: 00000100:00080000:0.0:1784403193.583801:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784403193.585063:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a4302ca80 x1871082260803712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403193.585082:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260803712:0@lo:400: 00010000:00010000:3.0:1784403193.696916:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403194.088315:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260803968:0@lo:13: 00000100:00100000:3.0:1784403194.088442:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403194.092395:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260803968 00000100:00100000:1.0:1784403194.092421:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260803968 00000100:00100000:1.0:1784403194.092500:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784403194.092513:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3567:x1871082260803968:12345-0@lo:13: 00002000:00000024:1.0:1784403194.093310:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403194.093462:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3567:x1871082260803968:12345-0@lo:13: Request processed in 949us (5017us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403194.093474:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784403194.095210:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b5aa00 x1871082260803968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403194.095275:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260803968:0@lo:13: 00000001:00080000:3.0:1784403194.184446:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1784403194.719718:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403195.744446:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403196.771665:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403197.791684:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403198.694086:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260804480:0@lo:400: 00000100:00100000:1.0:1784403198.694187:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403198.694278:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784403198.694285:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260804096:0@lo:400: 00000100:00100000:1.0:1784403198.694320:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403198.694358:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260804224:0@lo:400: 00000100:00100000:1.0:1784403198.694388:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403198.694409:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784403198.694414:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260804352:0@lo:400: 00000100:00100000:1.0:1784403198.694437:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403198.694478:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260804480 00000100:00100000:1.0:1784403198.694487:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260804480 00000100:00100000:1.0:1784403198.694559:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784403198.694571:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260804480:12345-0@lo:400: 00000100:00100000:1.0:1784403198.694648:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260804480:12345-0@lo:400: Request processed in 67us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403198.694657:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784403198.694686:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260804096 00000100:00100000:1.0:1784403198.694690:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260804096 00000100:00100000:1.0:1784403198.694715:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784403198.694721:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:3567:x1871082260804096:12345-0@lo:400: 00000100:00100000:1.0:1784403198.694752:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:3567:x1871082260804096:12345-0@lo:400: Request processed in 31us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403198.694758:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784403198.694812:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260804224 00000100:00100000:1.0:1784403198.694816:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260804224 00000100:00100000:1.0:1784403198.694840:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260804352 00000100:00100000:1.0:1784403198.694843:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260804352 00000100:00100000:1.0:1784403198.694859:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784403198.694901:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260804224:12345-0@lo:400: 00000100:00100000:1.0:1784403198.694940:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260804224:12345-0@lo:400: Request processed in 76us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403198.694948:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784403198.694960:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784403198.694967:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260804352:12345-0@lo:400: 00000100:00100000:1.0:1784403198.694994:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260804352:12345-0@lo:400: Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403198.695000:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1784403198.695021:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784403198.695026:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784403198.695067:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a58090000 x1871082260804352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403198.695084:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260804352:0@lo:400: 00010000:00080000:1.0:1784403198.695096:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a58093b80 x1871082260804224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403198.695105:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260804224:0@lo:400: 00000100:00100000:1.0:1784403198.695135:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260804096:0@lo:400: 00010000:00080000:1.0:1784403198.695145:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a58090a80 x1871082260804480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403198.695153:0:3567:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784403198.695173:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260804480:0@lo:400: 00010000:00010000:3.0:1784403198.816578:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403199.210365:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260804608:0@lo:13: 00000100:00100000:2.0:1784403199.210489:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403199.211390:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260804608 00000100:00100000:1.0:1784403199.211403:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260804608 00000100:00100000:1.0:1784403199.213094:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784403199.213113:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260804608:12345-0@lo:13: 00002000:00000024:1.0:1784403199.213160:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403199.213272:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260804608:12345-0@lo:13: Request processed in 164us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403199.213280:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784403199.213344:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a48971c00 x1871082260804608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403199.213368:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260804608:0@lo:13: 00010000:00010000:2.0:1784403199.845573:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403200.865064:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403201.887228:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403202.912685:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403203.807528:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260804736:0@lo:400: 00000100:00100000:0.0:1784403203.807636:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403203.807824:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260804736 00000100:00100000:2.0:1784403203.807835:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260804736 00000100:00100000:2.0:1784403203.807929:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784403203.807942:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:3565:x1871082260804736:12345-0@lo:400: 00000100:00100000:3.0:1784403203.808248:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260804864:0@lo:400: 00000100:00100000:3.0:1784403203.808284:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403203.808335:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260804992:0@lo:400: 00000100:00100000:3.0:1784403203.808362:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403203.808386:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784403203.808392:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260805120:0@lo:400: 00000100:00100000:3.0:1784403203.808421:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403203.808456:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260804864 00000100:00100000:3.0:1784403203.808460:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260804864 00000100:00100000:3.0:1784403203.808492:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260804992 00000100:00100000:3.0:1784403203.808495:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260804992 00000100:00100000:3.0:1784403203.808526:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784403203.808533:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260804864:12345-0@lo:400: 00000100:00100000:3.0:1784403203.808573:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260804864:12345-0@lo:400: Request processed in 40us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403203.808581:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784403203.808599:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784403203.808606:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260804992:12345-0@lo:400: 00000100:00100000:3.0:1784403203.808636:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260804992:12345-0@lo:400: Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403203.808641:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784403203.808663:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260805120 00000100:00100000:3.0:1784403203.808667:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260805120 00000100:00100000:3.0:1784403203.808695:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784403203.808701:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260805120:12345-0@lo:400: 00000100:00100000:3.0:1784403203.808746:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260805120:12345-0@lo:400: Request processed in 45us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403203.808757:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1784403203.808776:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784403203.808781:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784403203.808829:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b5ad80 x1871082260804864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403203.808846:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260804864:0@lo:400: 00010000:00080000:3.0:1784403203.808896:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b5a300 x1871082260805120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403203.808906:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260805120:0@lo:400: 00010000:00080000:3.0:1784403203.808928:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b59f80 x1871082260804992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403203.808937:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260804992:0@lo:400: 00000100:00100000:2.0:1784403203.809431:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:3565:x1871082260804736:12345-0@lo:400: Request processed in 1489us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403203.809440:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784403203.809543:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260804736:0@lo:400: 00010000:00010000:2.0:1784403203.944100:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403204.320022:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260805248:0@lo:13: 00000100:00100000:1.0:1784403204.320121:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403204.320233:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260805248 00000100:00100000:1.0:1784403204.320244:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260805248 00000100:00100000:1.0:1784403204.320311:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784403204.320323:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260805248:12345-0@lo:13: 00002000:00000024:1.0:1784403204.320372:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403204.320432:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260805248:12345-0@lo:13: Request processed in 111us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403204.320440:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784403204.320485:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a58090a80 x1871082260805248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403204.320506:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260805248:0@lo:13: 00010000:00010000:3.0:1784403204.961483:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784403205.847548:0:7989:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784403205.847559:0:7989:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1784403205.847714:0:7989:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c8a42cc6000 00000020:01000004:1.0:1784403205.847737:0:7989:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784403205.847754:0:7989:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1784403205.847771:0:7989:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c8a5809b380) 00000020:00000080:1.0:1784403205.847794:0:7989:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784403205.882417:0:7989:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784403205.882707:0:7989:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784403205.928822:0:7989:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784403205.938699:0:7989:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784403205.938747:0:7989:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784403205.938809:0:7989:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784403205.938851:0:7989:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784403205.939315:0:7989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784403205.939330:0:7989:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784403205.939344:0:7989:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6828175665afa5a1 00000020:01000004:2.0:1784403205.939355:0:7989:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784403205.939382:0:7989:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784403205.939387:0:7989:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784403205.939395:0:7989:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784403205.939420:0:7989:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784403205.939425:0:7989:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:2.0:1784403205.984668:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1784403205.996201:0:7989:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784403205.996279:0:7989:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.128@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1784403205.996284:0:7989:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784403205.996286:0:7989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784403205.996287:0:7989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403205.996288:0:7989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784403205.996290:0:7989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403205.996291:0:7989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403205.996293:0:7989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784403205.996295:0:7989:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784403205.996297:0:7989:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784403205.996299:0:7989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403205.996300:0:7989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784403205.996305:0:7989:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1784403205.996307:0:7989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784403205.996309:0:7989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784403205.996310:0:7989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403205.996312:0:7989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784403205.996313:0:7989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403205.996314:0:7989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403205.996315:0:7989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784403205.996316:0:7989:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784403205.996317:0:7989:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784403205.996318:0:7989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403205.996319:0:7989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784403205.996354:0:7989:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784403205.996381:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260805376:0@lo:253: 00000100:00100000:1.0:1784403205.996980:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403205.997151:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745a540 going to sleep for 11 seconds 00000100:00100000:3.0:1784403206.001265:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260805376 00000100:00100000:3.0:1784403206.001493:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260805376 00000100:00100000:3.0:1784403206.001760:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784403206.001775:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:7989:x1871082260805376:12345-0@lo:253: 20000000:01000000:3.0:1784403206.001826:0:6287:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784403206.001831:0:6287:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1784403206.001851:0:6287:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1784403206.001856:0:6287:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1784403206.003167:0:6287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784403206.003443:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1784403206.003460:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1784403206.003501:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1784403206.003509:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1784403206.003546:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1784403206.003592:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1784403206.004006:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1784403206.004029:0:6287:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:3.0:1784403206.004031:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:3.0:1784403206.004063:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1784403206.004070:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784403206.004142:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1784403206.004151:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:3.0:1784403206.004185:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1784403206.004194:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1784403206.004224:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1784403206.004274:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1784403206.005050:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1784403206.005072:0:6287:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:3.0:1784403206.005074:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:2.0:1784403206.021518:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1784403206.021564:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784403206.021658:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1784403206.021667:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:2.0:1784403206.021694:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1784403206.021704:0:6287:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784403206.021800:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1784403206.021860:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1784403206.022140:0:6287:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1784403206.022144:0:6287:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1784403206.022153:0:6287:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784403206.022154:0:6287:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784403206.022157:0:6287:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784403206.022175:0:6287:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784403206.022178:0:6287:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784403206.022239:0:6287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1784403206.022243:0:6287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784403206.026663:0:7991:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1784403206.026803:0:7991:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1784403206.026849:0:7991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1784403206.028115:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1784403206.028174:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1784403206.028270:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1784403206.028287:0:6287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784403206.028290:0:6287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784403206.029274:0:7992:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1784403206.029348:0:7992:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1784403206.029403:0:7992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1784403206.031059:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1784403206.031398:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1784403206.031456:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1784403206.031478:0:6287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784403206.031481:0:6287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784403206.037707:0:7993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1784403206.038290:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1784403206.038343:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1784403206.038427:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1784403206.038441:0:6287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784403206.038444:0:6287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784403206.040631:0:7994:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1784403206.040779:0:7994:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1784403206.040852:0:7994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1784403206.041628:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1784403206.041678:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1784403206.041765:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1784403206.041789:0:6287:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784403206.041813:0:6287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.041856:0:6287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a41671200/0x6828175665afa4f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa4f2 expref: 16 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.041895:0:6287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a5b67aa00/0x6828175665afa523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa51c expref: 16 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.041904:0:6287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa546 expref: 16 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.041912:0:6287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a414fe800/0x6828175665afa569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa562 expref: 16 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.041920:0:6287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce6800/0x6828175665afa593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa58c expref: 16 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.041928:0:6287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.041980:0:6287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce6800/0x6828175665afa593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa58c expref: 16 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.041997:0:6287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a7fce6800/0x6828175665afa593 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa58c expref: 16 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403206.042016:0:6287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48971180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260805504:0@lo:104: 00000100:00100000:2.0:1784403206.042119:0:6287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784403206.042198:0:6287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a414fe800/0x6828175665afa569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa562 expref: 16 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.042207:0:6287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a414fe800/0x6828175665afa569 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa562 expref: 16 pid: 6287 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403206.042224:0:6287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48971f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260805632:0@lo:104: 00010000:00010000:2.0:1784403206.042255:0:6287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa546 expref: 16 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.042263:0:6287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa54d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa546 expref: 16 pid: 6285 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403206.042271:0:6287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260805760:0@lo:104: 00010000:00010000:2.0:1784403206.042307:0:6287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a5b67aa00/0x6828175665afa523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa51c expref: 16 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.042316:0:6287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a5b67aa00/0x6828175665afa523 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa51c expref: 16 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403206.042324:0:6287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260805888:0@lo:104: 00010000:00010000:2.0:1784403206.042350:0:6287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a41671200/0x6828175665afa4f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa4f2 expref: 16 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.042359:0:6287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a41671200/0x6828175665afa4f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa4f2 expref: 16 pid: 6285 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403206.042367:0:6287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48970380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260806016:0@lo:104: 00000100:00100000:2.0:1784403206.042385:0:6287:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68840 going to sleep for 11 seconds 00000100:00100000:1.0:1784403206.042590:0:6274:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784403206.042611:0:6274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.042639:0:6274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.042648:0:6274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.042655:0:6274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.042670:0:6274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260805504 00000100:00100000:1.0:1784403206.042677:0:6274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260805504 00000100:00100000:1.0:1784403206.042717:0:6274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260805632 00000100:00100000:1.0:1784403206.042720:0:6274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260805632 00000100:00100000:1.0:1784403206.042728:0:6274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260805760 00000100:00100000:1.0:1784403206.042730:0:6274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260805760 00000100:00100000:1.0:1784403206.042737:0:6274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260805888 00000100:00100000:1.0:1784403206.042739:0:6274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260805888 00000100:00100000:1.0:1784403206.042747:0:6274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260806016 00000100:00100000:1.0:1784403206.042749:0:6274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260806016 00000100:00100000:1.0:1784403206.042760:0:6274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403206.042770:0:6274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a51b04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+7:6287:x1871082260805504:12345-0@lo:104: 00010000:00010000:1.0:1784403206.042783:0:6274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.042860:0:6274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784403206.042985:0:6274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a51b04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+7:6287:x1871082260805504:12345-0@lo:104: Request processed in 216us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.042992:0:6274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403206.043049:0:6274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784403206.043056:0:6274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58093b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+6:6287:x1871082260805632:12345-0@lo:104: 00010000:00010000:1.0:1784403206.043064:0:6274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043113:0:6274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784403206.043119:0:6274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58093b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+6:6287:x1871082260805632:12345-0@lo:104: Request processed in 65us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.043125:0:6274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784403206.043138:0:6274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784403206.043143:0:6274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+5:6287:x1871082260805760:12345-0@lo:104: 00010000:00010000:1.0:1784403206.043150:0:6274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043177:0:6274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784403206.043182:0:6274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+5:6287:x1871082260805760:12345-0@lo:104: Request processed in 40us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.043188:0:6274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784403206.043199:0:6274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784403206.043204:0:6274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+4:6287:x1871082260805888:12345-0@lo:104: 00010000:00010000:1.0:1784403206.043211:0:6274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043235:0:6274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784403206.043240:0:6274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+4:6287:x1871082260805888:12345-0@lo:104: Request processed in 36us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.043245:0:6274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784403206.043256:0:6274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784403206.043268:0:6274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+3:6287:x1871082260806016:12345-0@lo:104: 00010000:00010000:1.0:1784403206.043276:0:6274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043301:0:6274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1784403206.043305:0:6274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+3:6287:x1871082260806016:12345-0@lo:104: Request processed in 39us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.043310:0:6274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1784403206.043330:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784403206.043336:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043344:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403206.043349:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043357:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403206.043365:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403206.043371:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784403206.043405:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043411:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403206.043432:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043449:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afa58c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa593 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043464:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784403206.043467:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043472:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a5b67ac00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403206.043474:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043480:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403206.043486:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403206.043491:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784403206.043502:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043508:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403206.043522:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043528:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa562 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa569 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043536:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784403206.043543:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043548:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe600 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403206.043551:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043557:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403206.043563:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403206.043568:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784403206.043581:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043586:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403206.043591:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043597:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe600/0x6828175665afa546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa54d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043606:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403206.043609:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043614:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a41670400 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403206.043617:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043639:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403206.043645:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403206.043650:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784403206.043662:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043668:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403206.043673:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043680:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa51c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa523 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043691:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403206.043694:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043699:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe400 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403206.043701:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043707:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403206.043713:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403206.043723:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784403206.043736:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043740:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403206.043744:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043750:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe400/0x6828175665afa4f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa4f9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.043762:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403206.043764:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403206.043766:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403206.043790:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260806144:0@lo:103: 00000100:00100000:1.0:1784403206.043826:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784403206.044080:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403206.044153:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260806272:0@lo:103: 00000100:00100000:0.0:1784403206.044192:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260806528:0@lo:103: 00000100:00100000:1.0:1784403206.047140:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260806656:0@lo:103: 00000100:00100000:1.0:1784403206.047255:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.047310:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260806400:0@lo:103: 00000100:00100000:1.0:1784403206.047333:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403206.047336:0:6287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260805504:0@lo:104: 00000100:00100000:2.0:1784403206.047348:0:6287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260805632:0@lo:104: 00000100:00100000:2.0:1784403206.047356:0:6287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260805760:0@lo:104: 00000100:00100000:1.0:1784403206.047372:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260806144 00000100:00100000:2.0:1784403206.047376:0:6287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260805888:0@lo:104: 00000100:00100000:1.0:1784403206.047380:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260806144 00000100:00100000:2.0:1784403206.047385:0:6287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48970380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6287:1871082260806016:0@lo:104: 00010000:00010000:1.0:1784403206.047419:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce6800/0x6828175665afa593 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa58c expref: 17 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.047424:0:6287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403206.047445:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260806656 00000100:00100000:1.0:1784403206.047448:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260806656 00010000:00010000:1.0:1784403206.047457:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a41671200/0x6828175665afa4f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa4f2 expref: 18 pid: 6285 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403206.047476:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260806400 00000100:00100000:1.0:1784403206.047479:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260806400 00010000:00010000:1.0:1784403206.047490:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa54d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa546 expref: 19 pid: 6285 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403206.047503:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403206.047512:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58093480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260806144:12345-0@lo:103: 00010000:00010000:1.0:1784403206.047529:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403206.047534:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce6800/0x6828175665afa593 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa58c expref: 19 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.047546:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce6800/0x6828175665afa593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa58c expref: 19 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.047569:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6800/0x6828175665afa593 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa58c expref: 19 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.047587:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403206.047636:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58093480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+18:3566:x1871082260806144:12345-0@lo:103: Request processed in 124us (3808us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.047644:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403206.047665:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784403206.047672:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+17:3566:x1871082260806656:12345-0@lo:103: 00010000:00010000:1.0:1784403206.047681:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403206.047686:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a41671200/0x6828175665afa4f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa4f2 expref: 17 pid: 6285 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.047694:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a41671200/0x6828175665afa4f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa4f2 expref: 17 pid: 6285 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.047710:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41671200/0x6828175665afa4f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa4f2 expref: 17 pid: 6285 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.047721:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403206.047742:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+16:3566:x1871082260806656:12345-0@lo:103: Request processed in 71us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.047748:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784403206.047761:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784403206.047767:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+15:3568:x1871082260806400:12345-0@lo:103: 00010000:00010000:1.0:1784403206.047776:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403206.047780:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa54d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa546 expref: 15 pid: 6285 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.047788:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa546 expref: 15 pid: 6285 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.047798:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa54d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa546 expref: 15 pid: 6285 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.047808:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403206.047833:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+14:3568:x1871082260806400:12345-0@lo:103: Request processed in 66us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.047839:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784403206.048319:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403206.048461:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260806144:0@lo:103: 00000100:00100000:2.0:1784403206.048470:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260806656:0@lo:103: 00000100:00100000:2.0:1784403206.048964:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403206.049055:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260806528 00000100:00100000:3.0:1784403206.049063:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260806528 00010000:00010000:3.0:1784403206.049105:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a5b67aa00/0x6828175665afa523 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa51c expref: 14 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403206.049137:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260806272 00000100:00100000:3.0:1784403206.049140:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260806272 00010000:00010000:3.0:1784403206.049151:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a414fe800/0x6828175665afa569 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa562 expref: 15 pid: 6287 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403206.049254:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784403206.049263:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+15:3565:x1871082260806528:12345-0@lo:103: 00010000:00010000:3.0:1784403206.049281:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403206.049287:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a5b67aa00/0x6828175665afa523 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa51c expref: 15 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049297:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a5b67aa00/0x6828175665afa523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa51c expref: 15 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049315:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67aa00/0x6828175665afa523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa51c expref: 15 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049330:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403206.049392:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+14:3565:x1871082260806528:12345-0@lo:103: Request processed in 130us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.049399:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784403206.049415:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784403206.049421:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+13:3567:x1871082260806272:12345-0@lo:103: 00010000:00010000:3.0:1784403206.049428:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403206.049433:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a414fe800/0x6828175665afa569 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa562 expref: 13 pid: 6287 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049442:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a414fe800/0x6828175665afa569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa562 expref: 13 pid: 6287 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049452:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a414fe800/0x6828175665afa569 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa562 expref: 13 pid: 6287 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049477:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049486:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049502:0:6276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049510:0:6276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049517:0:6276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049524:0:6276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049531:0:6276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a5b67b200 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403206.049537:0:6276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049545:0:6276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049558:0:6276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.049570:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403206.049598:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+12:3567:x1871082260806272:12345-0@lo:103: Request processed in 177us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.049614:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784403206.049648:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260806272:0@lo:103: 00000100:00100000:3.0:1784403206.049674:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260806528:0@lo:103: 00010000:00010000:2.0:1784403206.049741:0:6287:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.049749:0:6287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.049756:0:6287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67b200/0x6828175665afa5a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784403206.049774:0:6287:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784403206.050907:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260806400:0@lo:103: 00000100:00100000:3.0:1784403206.136057:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+11:7989:x1871082260805376:12345-0@lo:253: Request processed in 134272us (139064us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.136077:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784403206.136200:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260805376:0@lo:253: 10000000:01000000:1.0:1784403206.136222:0:7989:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784403206.136226:0:7989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784403206.136249:0:7989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784403206.136251:0:7989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403206.136252:0:7989:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1784403206.136253:0:7989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403206.136254:0:7989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403206.136256:0:7989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784403206.136257:0:7989:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784403206.136259:0:7989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403206.136261:0:7989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784403206.136291:0:7989:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c8a42cc6000 from lustre-OST0001 10000000:01000000:1.0:1784403206.136323:0:7989:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784403206.136327:0:7989:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784403206.136336:0:7989:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c8a526f8000 local copy 10000000:01000000:1.0:1784403206.136342:0:7989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784403206.136393:0:7989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.136405:0:7989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.136415:0:7989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403206.136438:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260806784:0@lo:101: 00000100:00100000:1.0:1784403206.136488:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.136602:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745a600 going to sleep for 11 seconds 00000100:00100000:2.0:1784403206.136684:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260806784 00000100:00100000:2.0:1784403206.136692:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260806784 00000100:00100000:2.0:1784403206.136834:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784403206.136845:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+11:7989:x1871082260806784:12345-0@lo:101: 00010000:00010000:2.0:1784403206.136861:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403206.137145:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce7400/0x6828175665afa5b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa5af expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.137177:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce7400/0x6828175665afa5b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa5af expref: 12 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.137188:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce7400/0x6828175665afa5b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa5af expref: 12 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.137198:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403206.137249:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260806784:12345-0@lo:101: Request processed in 406us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.137256:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784403206.137333:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260806784:0@lo:101: 00010000:00010000:1.0:1784403206.137348:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.137358:0:7989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403206.137502:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260806912:0@lo:501: 00000100:00100000:1.0:1784403206.137526:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.137580:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745a600 going to sleep for 11 seconds 00000100:00100000:3.0:1784403206.137615:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260806912 00000100:00100000:3.0:1784403206.137619:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260806912 00000100:00100000:3.0:1784403206.137673:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784403206.137680:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260806912:12345-0@lo:501: 00000100:00100000:3.0:1784403206.138047:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260806912:12345-0@lo:501: Request processed in 367us (518us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784403206.138055:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784403206.138247:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260806912:0@lo:501: 10000000:01000000:2.0:1784403206.138265:0:7989:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784403206.138300:0:7989:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784403206.138307:0:7989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.138324:0:7989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.138332:0:7989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.138405:0:7989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784403206.138434:0:7989:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c8a42cc6000 10000000:01000000:2.0:1784403206.138440:0:7989:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784403206.138446:0:7989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784403206.138449:0:7989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784403206.138455:0:7989:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1784403206.138458:0:7989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784403206.138482:0:7989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.138491:0:7989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.138500:0:7989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403206.138516:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807040:0@lo:101: 00000100:00100000:2.0:1784403206.138550:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403206.138581:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784403206.138638:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260807040 00000100:00100000:3.0:1784403206.138643:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260807040 00000100:00100000:3.0:1784403206.138677:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784403206.138685:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260807040:12345-0@lo:101: 00010000:00010000:3.0:1784403206.138694:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403206.138705:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6400/0x6828175665afa5c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa5bd expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.138725:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6400/0x6828175665afa5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa5bd expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.138735:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6400/0x6828175665afa5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa5bd expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.138744:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6400, rc 0) 00000100:00100000:3.0:1784403206.138784:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260807040:12345-0@lo:101: Request processed in 100us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.138790:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784403206.138914:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807040:0@lo:101: 00010000:00010000:0.0:1784403206.138928:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403206.138936:0:7989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403206.139022:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807168:0@lo:501: 00000100:00100000:0.0:1784403206.139050:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403206.139073:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45718a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784403206.139197:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260807168 00000100:00100000:3.0:1784403206.139201:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260807168 00000100:00100000:3.0:1784403206.139234:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784403206.139241:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260807168:12345-0@lo:501: 00000100:00100000:3.0:1784403206.139461:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260807168:12345-0@lo:501: Request processed in 219us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.139469:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784403206.139673:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807168:0@lo:501: 00000100:00100000:0.0:1784403206.139717:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807296:0@lo:503: 00000100:00100000:0.0:1784403206.139756:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403206.139976:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45718a80 going to sleep for 11 seconds 00010000:00010000:1.0:1784403206.140037:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403206.140046:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.140054:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a41671200 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403206.140058:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.140069:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403206.140076:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403206.140081:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784403206.140118:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.140124:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403206.140152:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.140160:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6828175665afa5b6 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.140176:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403206.140185:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403206.140187:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403206.140231:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784403206.140245:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260807424:0@lo:103: 00000100:00100000:0.0:1784403206.140279:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.140551:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260807424 00000100:00100000:1.0:1784403206.140557:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260807424 00000100:00100000:1.0:1784403206.140686:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784403206.140696:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+13:3568:x1871082260807424:12345-0@lo:103: 00010000:00010000:1.0:1784403206.140710:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403206.140729:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce7400/0x6828175665afa5b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa5af expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.140743:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403206.140788:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+12:3568:x1871082260807424:12345-0@lo:103: Request processed in 94us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.140795:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784403206.140852:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260807424:0@lo:103: 00000100:00100000:2.0:1784403206.141004:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260807296 00000100:00100000:2.0:1784403206.141009:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260807296 00000100:00100000:2.0:1784403206.141043:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784403206.141051:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260807296:12345-0@lo:503: 00000100:00100000:2.0:1784403206.141290:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260807296:12345-0@lo:503: Request processed in 239us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403206.141296:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784403206.141478:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807296:0@lo:503: 00000040:00080000:0.0:1784403206.142088:0:7989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784403206.142187:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807552:0@lo:502: 00000100:00100000:0.0:1784403206.142242:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403206.142287:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45718a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784403206.146315:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260807552 00000100:00100000:2.0:1784403206.146335:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260807552 00000100:00100000:2.0:1784403206.146446:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784403206.146459:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260807552:12345-0@lo:502: 00000100:00100000:2.0:1784403206.146837:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260807552:12345-0@lo:502: Request processed in 379us (4594us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403206.146846:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784403206.147180:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807552:0@lo:502: 00000040:00080000:0.0:1784403206.147546:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1784403206.147620:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1784403206.147656:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1784403206.147705:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1784403206.147743:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1784403206.147792:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1784403206.147840:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807680:0@lo:502: 00000100:00100000:0.0:1784403206.148023:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403206.148143:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45718a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784403206.148367:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260807680 00000100:00100000:3.0:1784403206.148376:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260807680 00000100:00100000:3.0:1784403206.148439:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784403206.148449:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260807680:12345-0@lo:502: 00000100:00100000:3.0:1784403206.148679:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260807680:12345-0@lo:502: Request processed in 230us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.148686:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784403206.148794:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807680:0@lo:502: 00000040:00080000:1.0:1784403206.148950:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1784403206.148963:0:7989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1784403206.150751:0:7997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784403206.150767:0:7997:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1784403206.150776:0:7997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403206.150779:0:7997:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1784403206.150788:0:7997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784403206.150830:0:7997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c8a72e44d40) 00000020:00000080:1.0:1784403206.150860:0:7997:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784403206.150903:0:7997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784403206.150995:0:7997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a42cc6000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1784403206.151004:0:7997:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784403206.151013:0:7997:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6828175665afa5d2 00010000:00010000:3.0:1784403206.163601:0:7997:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1784403206.167516:0:7997:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1784403206.172733:0:7997:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784403206.173509:0:7997:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1784403206.181427:0:7997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1784403206.182464:0:7997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1784403206.184423:0:7997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1784403206.184439:0:7997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403206.184448:0:7997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403206.184450:0:7997:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1784403206.184455:0:7997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784403206.184459:0:7997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403206.184460:0:7997:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784403206.184463:0:7997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784403206.184471:0:7997:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784403206.184541:0:7997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403206.184544:0:7997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403206.184545:0:7997:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784403206.184549:0:7997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784403206.184840:0:7989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1784403206.184901:0:7989:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784403206.184936:0:7989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.184952:0:7989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403206.184962:0:7989:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a42cc6000 from 1 10000000:01000000:1.0:1784403206.184966:0:7989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784403206.185015:0:7989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.185022:0:7989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.185036:0:7989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403206.185066:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807808:0@lo:101: 00000100:00100000:1.0:1784403206.185168:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.185218:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403206.185419:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260807808 00000100:00100000:0.0:1784403206.185429:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260807808 00000100:00100000:0.0:1784403206.185516:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784403206.185534:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+12:7989:x1871082260807808:12345-0@lo:101: 00010000:00010000:0.0:1784403206.185552:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403206.185566:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a40031400/0x6828175665afa5e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa5d9 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403206.185592:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a40031400/0x6828175665afa5e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa5d9 expref: 13 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403206.185604:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a40031400/0x6828175665afa5e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa5d9 expref: 13 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403206.185612:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40031400, rc 0) 00000100:00100000:0.0:1784403206.185658:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260807808:12345-0@lo:101: Request processed in 127us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403206.185666:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784403206.185750:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807808:0@lo:101: 00010000:00010000:1.0:1784403206.185766:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.185776:0:7989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403206.185914:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807936:0@lo:501: 00000100:00100000:1.0:1784403206.185941:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.189842:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403206.190858:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260807936 00000100:00100000:3.0:1784403206.193150:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260807936 00000100:00100000:3.0:1784403206.193236:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784403206.193248:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260807936:12345-0@lo:501: 00000100:00100000:3.0:1784403206.193693:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260807936:12345-0@lo:501: Request processed in 446us (7750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.193703:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784403206.193849:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260807936:0@lo:501: 00000100:00100000:1.0:1784403206.194031:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808064:0@lo:503: 00000100:00100000:1.0:1784403206.194103:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.194141:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403206.194159:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260808064 00000100:00100000:1.0:1784403206.194163:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260808064 00000100:00100000:1.0:1784403206.194188:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784403206.194194:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260808064:12345-0@lo:503: 00000100:00100000:1.0:1784403206.194716:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260808064:12345-0@lo:503: Request processed in 518us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.194723:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784403206.194768:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808064:0@lo:503: 00000040:00080000:1.0:1784403206.195743:0:7989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784403206.195837:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808192:0@lo:502: 00000100:00100000:1.0:1784403206.196004:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.196046:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403206.196076:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260808192 00000100:00100000:1.0:1784403206.196084:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260808192 00000100:00100000:1.0:1784403206.196139:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784403206.196148:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260808192:12345-0@lo:502: 00000100:00100000:1.0:1784403206.196397:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260808192:12345-0@lo:502: Request processed in 249us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.196403:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784403206.196449:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808192:0@lo:502: 00000040:00080000:1.0:1784403206.196729:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1784403206.196805:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1784403206.196831:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808320:0@lo:502: 00000100:00100000:1.0:1784403206.197144:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.197282:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403206.197308:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260808320 00000100:00100000:1.0:1784403206.197313:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260808320 00000100:00100000:2.0:1784403206.200271:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784403206.200297:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260808320:12345-0@lo:502: 00000100:00100000:2.0:1784403206.200678:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260808320:12345-0@lo:502: Request processed in 391us (3532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403206.200688:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784403206.201499:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808320:0@lo:502: 00000040:00080000:0.0:1784403206.201718:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784403206.201737:0:7989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1784403206.202402:0:8001:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784403206.202413:0:8001:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403206.202416:0:8001:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784403206.202424:0:8001:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a42cc6000 00000020:00000080:0.0:1784403206.202426:0:8001:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784403206.202442:0:8001:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403206.202445:0:8001:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403206.202446:0:8001:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784403206.202448:0:8001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1784403206.202587:0:7989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784403206.202608:0:7989:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784403206.202631:0:7989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.202643:0:7989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403206.202689:0:7989:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784403206.202693:0:7989:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c8a42cc6000 10000000:01000000:3.0:1784403206.202709:0:7989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c8a42cc6000 10000000:01000000:3.0:1784403206.202715:0:7989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784403206.202721:0:7989:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a42cc6000 from 1 10000000:01000000:3.0:1784403206.202725:0:7989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784403206.202774:0:7989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.202783:0:7989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.202795:0:7989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403206.202821:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808448:0@lo:101: 00000100:00100000:3.0:1784403206.202926:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403206.203328:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a51b15600 going to sleep for 11 seconds 00000100:00100000:2.0:1784403206.203392:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260808448 00000100:00100000:2.0:1784403206.203402:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260808448 00000100:00100000:2.0:1784403206.203452:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784403206.203461:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260808448:12345-0@lo:101: 00010000:00010000:2.0:1784403206.203489:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403206.203506:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a5b67a200/0x6828175665afa5ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa5e7 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.203536:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a5b67a200/0x6828175665afa5ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa5e7 expref: 14 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.203548:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a5b67a200/0x6828175665afa5ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa5e7 expref: 14 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.203568:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a5b67a200, rc 0) 00000100:00100000:2.0:1784403206.203699:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:7989:x1871082260808448:12345-0@lo:101: Request processed in 238us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403206.203706:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784403206.203837:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808448:0@lo:101: 00010000:00010000:3.0:1784403206.203855:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.204056:0:7989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403206.204283:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808576:0@lo:501: 00000100:00100000:2.0:1784403206.204316:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403206.204384:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68480 going to sleep for 11 seconds 00000100:00100000:0.0:1784403206.204420:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260808576 00000100:00100000:0.0:1784403206.204426:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260808576 00000100:00100000:0.0:1784403206.204701:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784403206.204722:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:7989:x1871082260808576:12345-0@lo:501: 00000100:00100000:0.0:1784403206.205112:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:7989:x1871082260808576:12345-0@lo:501: Request processed in 391us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403206.205120:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784403206.205220:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808576:0@lo:501: 00000100:00100000:2.0:1784403206.205260:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808704:0@lo:503: 00000100:00100000:2.0:1784403206.205306:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403206.205581:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68480 going to sleep for 11 seconds 00000100:00100000:1.0:1784403206.205642:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260808704 00000100:00100000:1.0:1784403206.205648:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260808704 00000100:00100000:1.0:1784403206.205678:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784403206.205686:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:7989:x1871082260808704:12345-0@lo:503: 00000100:00100000:1.0:1784403206.206145:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:7989:x1871082260808704:12345-0@lo:503: Request processed in 458us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.206152:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784403206.206614:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808704:0@lo:503: 00000040:00080000:2.0:1784403206.207166:0:7989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784403206.207267:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808832:0@lo:502: 00000100:00100000:2.0:1784403206.207335:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403206.207422:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68480 going to sleep for 11 seconds 00000100:00100000:1.0:1784403206.207468:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260808832 00000100:00100000:1.0:1784403206.207474:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260808832 00000100:00100000:1.0:1784403206.207551:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784403206.207560:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:7989:x1871082260808832:12345-0@lo:502: 00000100:00100000:1.0:1784403206.207800:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:7989:x1871082260808832:12345-0@lo:502: Request processed in 239us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.207808:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784403206.207925:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808832:0@lo:502: 00000040:00080000:2.0:1784403206.208198:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1784403206.208248:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1784403206.208277:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1784403206.208333:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1784403206.208367:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1784403206.208406:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1784403206.208435:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1784403206.208460:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784403206.208523:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784403206.208560:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784403206.208589:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784403206.208632:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784403206.208665:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784403206.208699:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784403206.208747:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784403206.208784:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784403206.208818:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784403206.208902:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784403206.208939:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784403206.208987:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784403206.209040:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784403206.209078:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784403206.209128:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784403206.209172:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784403206.209208:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1784403206.209239:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1784403206.209293:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1784403206.209333:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1784403206.209365:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1784403206.209412:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1784403206.209448:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1784403206.209480:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1784403206.209513:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1784403206.209564:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1784403206.209599:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1784403206.209664:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1784403206.209701:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1784403206.209755:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808960:0@lo:502: 00000100:00100000:2.0:1784403206.209840:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403206.215103:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68480 going to sleep for 11 seconds 00000100:00100000:0.0:1784403206.215582:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260808960 00000100:00100000:0.0:1784403206.215596:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260808960 00000100:00100000:0.0:1784403206.215669:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784403206.215681:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:7989:x1871082260808960:12345-0@lo:502: 00000100:00100000:0.0:1784403206.216351:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:7989:x1871082260808960:12345-0@lo:502: Request processed in 670us (6509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403206.216362:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784403206.216492:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260808960:0@lo:502: 00000040:00080000:2.0:1784403206.216635:0:7989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1784403206.216656:0:7989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1784403206.217598:0:8002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784403206.217619:0:8002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c8a72e419c0) 00000020:00000080:1.0:1784403206.217645:0:8002:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1784403206.217853:0:8002:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a42cc6000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784403206.217858:0:8002:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c8a42cc6000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784403206.217860:0:8002:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a42cc6000 3 00010000:00080000:1.0:1784403206.218069:0:8002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c8a72e4d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.128@tcp at head 00010000:00010000:1.0:1784403206.224190:0:8002:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1784403206.224334:0:8002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1784403206.224416:0:8002:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784403206.226007:0:8002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6828175665afa5fc 00000100:00080000:1.0:1784403206.226030:0:8002:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784403206.226039:0:8002:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c8a72e4d800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1784403206.226103:0:8002:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a7fec5500 x1871082260809088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784403206.226143:0:8002:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784403206.226370:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260809216:0@lo:400: 00000100:00100000:3.0:1784403206.226464:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403206.226528:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260809344:0@lo:400: 00000100:00100000:3.0:1784403206.226578:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403206.226599:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784403206.226605:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260809472:0@lo:400: 00000100:00100000:3.0:1784403206.226643:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403206.226678:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260809216 00000100:00100000:3.0:1784403206.226686:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260809216 00000100:00100000:3.0:1784403206.226736:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260809344 00000100:00100000:3.0:1784403206.226740:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260809344 00000100:00100000:3.0:1784403206.226770:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784403206.226779:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260809216:12345-0@lo:400: 00000100:00100000:3.0:1784403206.226843:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260809216:12345-0@lo:400: Request processed in 64us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.226851:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784403206.227326:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784403206.227337:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260809344:12345-0@lo:400: 00000100:00100000:3.0:1784403206.227381:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260809344:12345-0@lo:400: Request processed in 47us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.227387:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1784403206.227413:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784403206.227445:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b5a300 x1871082260809216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403206.227460:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260809216:0@lo:400: 00010000:00080000:3.0:1784403206.227495:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b5ad80 x1871082260809344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403206.227504:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260809344:0@lo:400: 00000100:00100000:1.0:1784403206.227622:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260809472 00000100:00100000:1.0:1784403206.227628:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260809472 00000100:00100000:1.0:1784403206.227695:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784403206.227704:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260809472:12345-0@lo:400: 00000100:00100000:1.0:1784403206.227753:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260809472:12345-0@lo:400: Request processed in 52us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.227760:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784403206.227793:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a81b59880 x1871082260809472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403206.227802:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260809472:0@lo:400: 00000100:00080000:3.0:1784403206.228213:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403206.228417:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3564:1871082260809088:0@lo:38: 00000100:00100000:1.0:1784403206.228476:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1784403206.231223:0:8002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1784403206.232277:0:8004:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8c8a48971c00 x1871082260809600/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403206.232292:0:8004:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68480 going to sleep for 0 seconds 00000100:00100000:3.0:1784403206.232995:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260809088 00000100:00100000:3.0:1784403206.233006:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260809088 00000100:00100000:3.0:1784403206.233120:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784403206.233130:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3564:x1871082260809088:12345-0@lo:38: 00010000:00080000:3.0:1784403206.233171:0:6293:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:3.0:1784403206.233215:0:6293:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6828175665afa603 00000004:00100000:3.0:1784403206.233238:0:6293:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784403206.233299:0:6293:0:(import.c:65:import_set_state_nolock()) ffff8c8a77cf1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784403206.233424:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3564:x1871082260809088:12345-0@lo:38: Request processed in 294us (4946us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403206.233433:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784403206.235139:0:3564:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a7fec5500 x1871082260809088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784403216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403206.235157:0:3564:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784403206.235170:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1784403206.235180:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784403206.235186:0:3564:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784403206.235200:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a72e4d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1784403206.235209:0:3564:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fe4f2f8d): req@ffff8c8a48971c00 x1871082260809600/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403206.235229:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3564:1871082260809088:0@lo:38: 00000100:00100000:1.0:1784403206.235388:0:8004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.235434:0:6303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260809600 00000100:00100000:1.0:1784403206.235441:0:6303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260809600 00000100:00100000:1.0:1784403206.235493:0:6303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784403206.235500:0:6303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8004:x1871082260809600:12345-0@lo:901: 00000100:00100000:1.0:1784403206.236377:0:6303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8004:x1871082260809600:12345-0@lo:901: Request processed in 872us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.236387:0:6303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1784403206.236416:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784403206.236449:0:8004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a48971c00 x1871082260809600/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784403222 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403206.236461:0:8004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8004:1871082260809600:0@lo:901: 00000020:01000000:2.0:1784403206.236678:0:7989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1784403206.236715:0:7989:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784403206.236747:0:7989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403206.236760:0:7989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784403206.236830:0:7989:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784403206.236832:0:7989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784403206.236834:0:7989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403206.236836:0:7989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403206.236837:0:7989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403206.236839:0:7989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403206.236840:0:7989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403206.236842:0:7989:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784403206.236844:0:7989:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784403206.236846:0:7989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403206.236847:0:7989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784403206.236851:0:7989:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1784403206.236854:0:7989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784403206.236855:0:7989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784403206.236856:0:7989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403206.236858:0:7989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403206.236859:0:7989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403206.236860:0:7989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403206.236861:0:7989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403206.236862:0:7989:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784403206.236951:0:7989:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784403206.236959:0:7989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403206.236960:0:7989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784403206.236988:0:7989:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784403206.237006:0:7989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48971f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260809728:0@lo:253: 00000100:00100000:2.0:1784403206.237057:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403206.237102:0:7989:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68840 going to sleep for 11 seconds 00000100:00100000:0.0:1784403206.237186:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260809728 00000100:00100000:0.0:1784403206.237192:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260809728 00000100:00100000:0.0:1784403206.237241:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784403206.237251:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:7989:x1871082260809728:12345-0@lo:253: 20000000:01000000:0.0:1784403206.237283:0:6285:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784403206.237302:0:6285:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784403206.275260:0:6285:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784403206.275285:0:6285:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1784403206.275348:0:6308:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784403206.275354:0:6308:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784403206.275383:0:6308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.275406:0:6308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a41670800/0x6828175665afa55b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa554 expref: 14 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.275416:0:6308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.275471:0:6308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a41670800/0x6828175665afa55b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa554 expref: 14 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403206.275486:0:6308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a41670800/0x6828175665afa55b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa554 expref: 14 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403206.275503:0:6308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6308:1871082260809856:0@lo:104: 00000100:00100000:3.0:1784403206.275593:0:6308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403206.275661:0:6308:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a51b15b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784403206.275726:0:6274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260809856 00000100:00100000:1.0:1784403206.275735:0:6274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260809856 00000100:00100000:1.0:1784403206.275796:0:6274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784403206.275807:0:6274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+3:6308:x1871082260809856:12345-0@lo:104: 00010000:00010000:1.0:1784403206.275820:0:6274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.275922:0:6274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784403206.275928:0:6274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64472369-fee1-4bb4-a407-7797860a37a0+3:6308:x1871082260809856:12345-0@lo:104: Request processed in 123us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.275952:0:6274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1784403206.275979:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403206.275986:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.275994:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ffc00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403206.275999:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276009:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403206.276015:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403206.276022:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784403206.276055:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276061:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403206.276084:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276105:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffc00/0x6828175665afa554 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa55b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276126:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403206.276128:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403206.276129:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403206.276151:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260809984:0@lo:103: 00000100:00100000:1.0:1784403206.276193:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403206.276238:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260809984 00000100:00100000:1.0:1784403206.276243:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260809984 00010000:00010000:1.0:1784403206.276261:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a41670800/0x6828175665afa55b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa554 expref: 15 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403206.276286:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784403206.276293:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42d01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+15:3567:x1871082260809984:12345-0@lo:103: 00010000:00010000:1.0:1784403206.276305:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403206.276310:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a41670800/0x6828175665afa55b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa554 expref: 15 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276321:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a41670800/0x6828175665afa55b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa554 expref: 15 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276339:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276347:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784403206.276361:0:6277:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003004581s 00010000:00010000:1.0:1784403206.276365:0:6277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276373:0:6277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276380:0:6277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276399:0:6277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276405:0:6277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403206.276409:0:6277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276418:0:6277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276428:0:6277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276439:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403206.276468:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42d01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+15:3567:x1871082260809984:12345-0@lo:103: Request processed in 176us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403206.276474:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784403206.276546:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260809984:0@lo:103: 00010000:00010000:1.0:1784403206.276574:0:6308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41670800/0x6828175665afa55b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa554 expref: 14 pid: 6286 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403206.276586:0:6308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6308:1871082260809856:0@lo:104: 00010000:00010000:1.0:1784403206.276600:0:6308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276608:0:6308:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276614:0:6308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403206.276626:0:6308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce7c00/0x6828175665afa60a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403206.286351:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:7989:x1871082260809728:12345-0@lo:253: Request processed in 49086us (49279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403206.286371:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784403206.286506:0:7989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64472369-fee1-4bb4-a407-7797860a37a0:7989:1871082260809728:0@lo:253: 10000000:01000000:3.0:1784403206.286526:0:7989:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784403206.286548:0:7989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784403206.286550:0:7989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784403206.286552:0:7989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784403206.286553:0:7989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784403206.286555:0:7989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784403206.286556:0:7989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784403206.286557:0:7989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784403206.286559:0:7989:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784403206.286560:0:7989:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784403206.286562:0:7989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784403206.286564:0:7989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784403206.286583:0:7989:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784403206.293754:0:7989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784403206.294128:0:7989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784403206.294375:0:7989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784403206.294567:0:7989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784403206.294775:0:7989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784403206.300109:0:7989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784403206.301630:0:7989:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1784403206.594265:0:7989:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1784403206.594276:0:7989:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1784403206.594320:0:7989:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784403206.594405:0:7989:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784403206.594422:0:7989:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784403206.594459:0:7989:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1784403207.007135:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403208.044131:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403209.057974:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403209.439098:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260810112:0@lo:13: 00000100:00100000:2.0:1784403209.439200:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403209.442847:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260810112 00000100:00100000:0.0:1784403209.442886:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260810112 00000100:00100000:0.0:1784403209.447610:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784403209.447641:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260810112:12345-0@lo:13: 00002000:00000024:0.0:1784403209.447701:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784403209.447905:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260810112:12345-0@lo:13: Request processed in 278us (8702us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403209.447916:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1784403209.447990:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784403209.448063:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7fec4000 x1871082260810112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403209.448092:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260810112:0@lo:13: 00010000:00010000:0.0:1784403210.079265:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403211.104011:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784403211.487080:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784403211.487093:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a43036800 from 30 10000000:01000000:1.0:1784403211.487100:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784403211.487171:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403211.487185:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403211.487197:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403211.487230:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260810240:0@lo:101: 00000100:00100000:1.0:1784403211.487324:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403211.487382:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.489210:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260810240 00000100:00100000:2.0:1784403211.489226:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260810240 00000100:00100000:2.0:1784403211.489288:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784403211.489299:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260810240:12345-0@lo:101: 00010000:00010000:2.0:1784403211.489321:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403211.489345:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a5b67b400/0x6828175665afa618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa611 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.489381:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a5b67b400/0x6828175665afa618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa611 expref: 14 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.489394:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a5b67b400/0x6828175665afa618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa611 expref: 14 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.489418:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a5b67b400, rc 0) 00000100:00100000:2.0:1784403211.489512:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260810240:12345-0@lo:101: Request processed in 215us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.489520:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784403211.489577:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48970700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260810752:0@lo:400: 00000100:00100000:2.0:1784403211.489623:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.489658:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784403211.489665:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260810624:0@lo:400: 00000100:00100000:2.0:1784403211.489693:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.489728:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260810752 00000100:00100000:2.0:1784403211.489731:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260810752 00000100:00100000:2.0:1784403211.489773:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784403211.489781:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260810752:12345-0@lo:400: 00000100:00100000:2.0:1784403211.489819:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260810752:12345-0@lo:400: Request processed in 40us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.489826:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784403211.489851:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260810624 00000100:00100000:2.0:1784403211.489855:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260810624 00000100:00100000:2.0:1784403211.489909:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784403211.489916:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260810624:12345-0@lo:400: 00000100:00080000:3.0:1784403211.490008:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784403211.490014:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784403211.490045:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260810368:0@lo:400: 00010000:00080000:3.0:1784403211.490056:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48970700 x1871082260810752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403211.490071:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48970700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260810752:0@lo:400: 00000100:00100000:1.0:1784403211.493617:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403211.493691:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784403211.493707:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260810496:0@lo:400: 00000100:00100000:1.0:1784403211.493759:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403211.493835:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260810240:0@lo:101: 00010000:00010000:1.0:1784403211.493889:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403211.493926:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403211.494035:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260810880:0@lo:501: 00000100:00100000:1.0:1784403211.494068:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403211.494101:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403211.494639:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260810368 00000100:00100000:1.0:1784403211.494649:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260810368 00000100:00100000:1.0:1784403211.494703:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260810496 00000100:00100000:1.0:1784403211.494707:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260810496 00000100:00100000:1.0:1784403211.494740:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784403211.494750:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260810368:12345-0@lo:400: 00000100:00100000:1.0:1784403211.494826:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260810368:12345-0@lo:400: Request processed in 76us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403211.494834:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784403211.494855:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784403211.494862:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260810496:12345-0@lo:400: 00000100:00100000:1.0:1784403211.494922:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260810496:12345-0@lo:400: Request processed in 61us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403211.494928:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1784403211.494965:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48973480 x1871082260810496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403211.494980:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260810496:0@lo:400: 00010000:00080000:1.0:1784403211.495003:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48972d80 x1871082260810368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403211.495030:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260810368:0@lo:400: 00000100:00080000:1.0:1784403211.495064:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403211.495268:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260810880 00000100:00100000:3.0:1784403211.495274:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260810880 00000100:00100000:3.0:1784403211.495305:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784403211.495312:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260810880:12345-0@lo:501: 00000100:00100000:3.0:1784403211.495727:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260810880:12345-0@lo:501: Request processed in 415us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.495734:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784403211.498863:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260810880:0@lo:501: 00000100:00100000:0.0:1784403211.498976:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260811008:0@lo:503: 00000100:00100000:0.0:1784403211.499093:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403211.499159:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.499421:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260810624:12345-0@lo:400: Request processed in 9502us (9724us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.499437:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784403211.499483:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260811008 00000100:00100000:2.0:1784403211.499491:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260811008 00000100:00100000:2.0:1784403211.499549:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784403211.499568:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260811008:12345-0@lo:503: 00000100:00100000:2.0:1784403211.500070:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260811008:12345-0@lo:503: Request processed in 502us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.500079:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784403211.500160:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260811008:0@lo:503: 00000100:00100000:2.0:1784403211.500397:0:8223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8223:1871082260811136:0@lo:502: 00000100:00100000:2.0:1784403211.500438:0:8223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.500466:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260811136 00000100:00100000:2.0:1784403211.500471:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260811136 00000100:00100000:2.0:1784403211.500499:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784403211.500507:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+14:8223:x1871082260811136:12345-0@lo:502: 00000100:00100000:2.0:1784403211.500743:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+14:8223:x1871082260811136:12345-0@lo:502: Request processed in 236us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.500750:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784403211.500786:0:8223:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.500801:0:8223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8223:1871082260811136:0@lo:502: 00000100:00100000:2.0:1784403211.500846:0:8223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8223:1871082260811264:0@lo:502: 00000100:00100000:2.0:1784403211.501022:0:8223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.501044:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260811264 00000100:00100000:2.0:1784403211.501049:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260811264 00000100:00100000:2.0:1784403211.501070:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784403211.501076:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+14:8223:x1871082260811264:12345-0@lo:502: 00000100:00100000:2.0:1784403211.501210:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+14:8223:x1871082260811264:12345-0@lo:502: Request processed in 133us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.501216:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784403211.501249:0:8223:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.501261:0:8223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8223:1871082260811264:0@lo:502: 00000040:00080000:2.0:1784403211.501277:0:8223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1784403211.501342:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1784403211.501363:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784403211.501374:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.501387:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403211.501398:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784403211.501401:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1784403211.501405:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784403211.501434:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.501442:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.501452:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403211.501465:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260811392:0@lo:101: 00000100:00100000:2.0:1784403211.501491:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.501503:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.501513:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260811392 00000100:00100000:2.0:1784403211.501516:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260811392 00000100:00100000:2.0:1784403211.501536:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784403211.501542:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260811392:12345-0@lo:101: 00010000:00010000:2.0:1784403211.501557:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403211.501570:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa626 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa61f expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.501596:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa61f expref: 15 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.501608:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa61f expref: 15 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.501619:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a5b67a400, rc 0) 00000100:00100000:2.0:1784403211.501644:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260811392:12345-0@lo:101: Request processed in 103us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.501649:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784403211.501674:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260811392:0@lo:101: 00010000:00010000:2.0:1784403211.501685:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.501694:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403211.501735:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260811520:0@lo:501: 00000100:00100000:2.0:1784403211.501759:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.501770:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.501779:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260811520 00000100:00100000:2.0:1784403211.501782:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260811520 00000100:00100000:2.0:1784403211.501798:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784403211.501802:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260811520:12345-0@lo:501: 00000100:00100000:2.0:1784403211.502095:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260811520:12345-0@lo:501: Request processed in 291us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.502107:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784403211.502137:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260811520:0@lo:501: 00000100:00100000:2.0:1784403211.502159:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260811648:0@lo:503: 00000100:00100000:2.0:1784403211.502194:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.502207:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.502218:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260811648 00000100:00100000:2.0:1784403211.502221:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260811648 00000100:00100000:2.0:1784403211.502241:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784403211.502248:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260811648:12345-0@lo:503: 00000100:00100000:2.0:1784403211.502568:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260811648:12345-0@lo:503: Request processed in 319us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.502575:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784403211.502613:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260811648:0@lo:503: 00000100:00100000:2.0:1784403211.502947:0:8224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8224:1871082260811776:0@lo:502: 00000100:00100000:2.0:1784403211.502983:0:8224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403211.503337:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260811776 00000100:00100000:3.0:1784403211.503344:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260811776 00000100:00100000:3.0:1784403211.503377:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784403211.503385:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:8224:x1871082260811776:12345-0@lo:502: 00000100:00100000:3.0:1784403211.503595:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:8224:x1871082260811776:12345-0@lo:502: Request processed in 210us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.503602:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1784403211.503764:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48973100 x1871082260810624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403211.503791:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260810624:0@lo:400: 00000100:00100000:2.0:1784403211.504132:0:8224:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.504147:0:8224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8224:1871082260811776:0@lo:502: 00000020:01000000:2.0:1784403211.504176:0:8224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784403211.504187:0:8224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403211.504190:0:8224:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784403211.504195:0:8224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784403211.504197:0:8224:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784403211.504219:0:8224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8224:1871082260811904:0@lo:502: 00000100:00100000:2.0:1784403211.504267:0:8224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.504288:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260811904 00000100:00100000:2.0:1784403211.504291:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260811904 00000100:00100000:2.0:1784403211.504320:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784403211.504327:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+15:8224:x1871082260811904:12345-0@lo:502: 00000100:00100000:2.0:1784403211.504478:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+15:8224:x1871082260811904:12345-0@lo:502: Request processed in 151us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.504485:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784403211.504517:0:8224:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.504528:0:8224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8224:1871082260811904:0@lo:502: 00000020:01000000:2.0:1784403211.504544:0:8224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403211.504549:0:8224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403211.504550:0:8224:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784403211.504554:0:8224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1784403211.504614:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1784403211.504633:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784403211.504645:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.504656:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403211.504667:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784403211.504670:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a5270b000 from 30 10000000:01000000:2.0:1784403211.504672:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784403211.504700:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.504707:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.504724:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403211.504737:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812032:0@lo:101: 00000100:00100000:2.0:1784403211.504764:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.504949:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.504964:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260812032 00000100:00100000:2.0:1784403211.504969:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260812032 00000100:00100000:2.0:1784403211.505010:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784403211.505017:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260812032:12345-0@lo:101: 00010000:00010000:2.0:1784403211.505028:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403211.505044:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a5b67be00/0x6828175665afa634 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa62d expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.505070:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a5b67be00/0x6828175665afa634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa62d expref: 16 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.505082:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a5b67be00/0x6828175665afa634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa62d expref: 16 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.505091:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a5b67be00, rc 0) 00000100:00100000:2.0:1784403211.505123:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260812032:12345-0@lo:101: Request processed in 107us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.505128:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784403211.505157:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812032:0@lo:101: 00010000:00010000:2.0:1784403211.505171:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.505191:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403211.505235:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812160:0@lo:501: 00000100:00100000:2.0:1784403211.505258:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.505270:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.505281:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260812160 00000100:00100000:2.0:1784403211.505284:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260812160 00000100:00100000:2.0:1784403211.505301:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784403211.505306:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260812160:12345-0@lo:501: 00000100:00100000:2.0:1784403211.505555:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260812160:12345-0@lo:501: Request processed in 248us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.505562:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784403211.505589:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812160:0@lo:501: 00000100:00100000:2.0:1784403211.505615:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812288:0@lo:503: 00000100:00100000:2.0:1784403211.505654:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.505666:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.505676:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260812288 00000100:00100000:2.0:1784403211.505679:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260812288 00000100:00100000:2.0:1784403211.505698:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784403211.505703:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260812288:12345-0@lo:503: 00000100:00100000:3.0:1784403211.508273:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260812288:12345-0@lo:503: Request processed in 2552us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.508290:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784403211.508382:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812288:0@lo:503: 00000100:00100000:3.0:1784403211.508652:0:8225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8225:1871082260812416:0@lo:502: 00000100:00100000:3.0:1784403211.508709:0:8225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403211.508743:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260812416 00000100:00100000:3.0:1784403211.508750:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260812416 00000100:00100000:3.0:1784403211.508806:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784403211.508815:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:8225:x1871082260812416:12345-0@lo:502: 00000100:00100000:3.0:1784403211.509082:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:8225:x1871082260812416:12345-0@lo:502: Request processed in 266us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.509089:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784403211.509139:0:8225:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403211.509153:0:8225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8225:1871082260812416:0@lo:502: 00000100:00100000:3.0:1784403211.509200:0:8225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8225:1871082260812544:0@lo:502: 00000100:00100000:3.0:1784403211.509228:0:8225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403211.509246:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260812544 00000100:00100000:3.0:1784403211.509250:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260812544 00000100:00100000:3.0:1784403211.509274:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784403211.509280:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:8225:x1871082260812544:12345-0@lo:502: 00000100:00100000:3.0:1784403211.509392:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:8225:x1871082260812544:12345-0@lo:502: Request processed in 111us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.509398:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784403211.509423:0:8225:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403211.509435:0:8225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8225:1871082260812544:0@lo:502: 00000040:00080000:3.0:1784403211.509453:0:8225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1784403211.509517:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1784403211.509537:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784403211.509549:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.509562:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403211.509573:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784403211.509576:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c8a5270b000 from 5 10000000:01000000:3.0:1784403211.509579:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784403211.509609:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.509618:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.509628:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403211.509640:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812672:0@lo:101: 00000100:00100000:3.0:1784403211.509674:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403211.509687:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403211.509700:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260812672 00000100:00100000:3.0:1784403211.509703:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260812672 00000100:00100000:3.0:1784403211.509724:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784403211.509731:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260812672:12345-0@lo:101: 00010000:00010000:3.0:1784403211.509741:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403211.509756:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce7800/0x6828175665afa642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa63b expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.509781:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce7800/0x6828175665afa642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa63b expref: 17 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.509793:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce7800/0x6828175665afa642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa63b expref: 17 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.509803:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7800, rc 0) 00000100:00100000:3.0:1784403211.509830:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260812672:12345-0@lo:101: Request processed in 99us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.509836:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784403211.509898:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812672:0@lo:101: 00010000:00010000:3.0:1784403211.509912:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.509922:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403211.509966:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812800:0@lo:256: 00000100:00100000:3.0:1784403211.510022:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403211.510040:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403211.510051:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260812800 00000100:00100000:3.0:1784403211.510054:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260812800 00000100:00100000:3.0:1784403211.510075:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784403211.510081:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260812800:12345-0@lo:256: 20000000:01000000:3.0:1784403211.510096:0:6285:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784403211.510117:0:6285:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784403211.510120:0:6285:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1784403211.510212:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260812800:12345-0@lo:256: Request processed in 130us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.510219:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784403211.510249:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812800:0@lo:256: 10000000:01000000:3.0:1784403211.510292:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784403211.510300:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.510308:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403211.510316:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784403211.510319:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1784403211.510321:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784403211.510337:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.510346:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.510364:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403211.510376:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812928:0@lo:101: 00000100:00100000:3.0:1784403211.510404:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403211.510417:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403211.510429:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260812928 00000100:00100000:3.0:1784403211.510433:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260812928 00000100:00100000:3.0:1784403211.510452:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784403211.510458:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260812928:12345-0@lo:101: 00010000:00010000:3.0:1784403211.510465:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403211.510474:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa649 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.510489:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa649 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.510496:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa649 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.510503:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6c00, rc 0) 00000100:00100000:3.0:1784403211.510530:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260812928:12345-0@lo:101: Request processed in 72us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.510536:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784403211.510561:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260812928:0@lo:101: 00010000:00010000:3.0:1784403211.510571:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403211.510589:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403211.510632:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260813056:0@lo:501: 00000100:00100000:3.0:1784403211.510656:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403211.510669:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403211.510680:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260813056 00000100:00100000:3.0:1784403211.510683:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260813056 00000100:00100000:3.0:1784403211.510703:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784403211.510709:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260813056:12345-0@lo:501: 00000100:00100000:3.0:1784403211.522188:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260813056:12345-0@lo:501: Request processed in 11464us (11516us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.522208:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784403211.522311:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260813056:0@lo:501: 00000100:00100000:3.0:1784403211.522379:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260813184:0@lo:503: 00000100:00100000:3.0:1784403211.522435:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403211.522471:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403211.522491:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260813184 00000100:00100000:3.0:1784403211.522498:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260813184 00000100:00100000:3.0:1784403211.522545:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784403211.522555:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260813184:12345-0@lo:503: 00000100:00100000:3.0:1784403211.523497:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260813184:12345-0@lo:503: Request processed in 939us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.523508:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784403211.523572:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260813184:0@lo:503: 00000100:00100000:2.0:1784403211.528252:0:8230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8230:1871082260813312:0@lo:502: 00000100:00100000:2.0:1784403211.528370:0:8230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.528425:0:8230:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784403211.528534:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260813312 00000100:00100000:3.0:1784403211.528544:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260813312 00000100:00100000:3.0:1784403211.528604:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784403211.528616:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:8230:x1871082260813312:12345-0@lo:502: 00000100:00100000:3.0:1784403211.529301:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:8230:x1871082260813312:12345-0@lo:502: Request processed in 683us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403211.529312:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784403211.532104:0:8230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8230:1871082260813312:0@lo:502: 00000020:01000000:3.0:1784403211.532171:0:8230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784403211.532181:0:8230:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1784403211.532195:0:8230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403211.532199:0:8230:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784403211.532205:0:8230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784403211.532210:0:8230:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.128@tcp to nid 0x20000c0a8cc80 (192.168.204.128@tcp) 00000020:01000000:3.0:1784403211.532251:0:8230:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784403211.532254:0:8230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784403211.532279:0:8230:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c8a527a19c0) 00000020:00000080:3.0:1784403211.532309:0:8230:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1784403211.532315:0:8230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784403211.532423:0:8230:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784403211.532430:0:8230:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784403211.532439:0:8230:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afa65e 00010000:00080000:3.0:1784403211.532493:0:8230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c8a453ba800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:3.0:1784403211.532760:0:8230:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1784403211.536347:0:8230:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1784403211.536377:0:8230:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784403211.541335:0:8230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784403211.541618:0:8230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784403211.541668:0:8230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1784403211.541735:0:8230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1784403211.546305:0:8233:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403211.546318:0:8233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784403211.552539:0:8230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784403211.552574:0:8230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784403211.554062:0:8230:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784403211.554103:0:8230:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6828175665afa665 00000100:00080000:2.0:1784403211.554119:0:8230:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784403211.554128:0:8230:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c8a453ba800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1784403211.554183:0:8230:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a48972300 x1871082260813440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784403211.554220:0:8230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784403211.554304:0:8230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403211.554311:0:8230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403211.554314:0:8230:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784403211.554318:0:8230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784403211.554322:0:8230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403211.554324:0:8230:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784403211.554327:0:8230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784403211.554329:0:8230:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784403211.554366:0:8230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8230:1871082260813568:0@lo:502: 00000100:00100000:2.0:1784403211.554476:0:8230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.554531:0:8230:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.555035:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260813568 00000100:00100000:2.0:1784403211.555044:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260813568 00000100:00100000:2.0:1784403211.555097:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784403211.555109:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:8230:x1871082260813568:12345-0@lo:502: 00000100:00100000:2.0:1784403211.555428:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:8230:x1871082260813568:12345-0@lo:502: Request processed in 320us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.555438:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784403211.555506:0:8230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8230:1871082260813568:0@lo:502: 00000020:01000000:2.0:1784403211.555541:0:8230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403211.555554:0:8230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403211.555557:0:8230:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784403211.555561:0:8230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1784403211.555749:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260813440:0@lo:8: 00000100:00100000:1.0:1784403211.556025:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403211.556073:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260813440 00000100:00100000:1.0:1784403211.556079:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260813440 00000100:00100000:1.0:1784403211.556106:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784403211.556112:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260813440:12345-0@lo:8: 00010000:00080000:1.0:1784403211.556147:0:7099:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1784403211.556183:0:7099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6828175665afa66c 00002000:00100000:1.0:1784403211.556202:0:7099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c8a72e4e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784403211.556207:0:7099:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1784403211.556211:0:7099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1784403211.556361:0:7099:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784403211.556540:0:7099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784403211.556570:0:7099:0:(import.c:65:import_set_state_nolock()) ffff8c8a72e4d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784403211.556988:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3564:x1871082260813440:12345-0@lo:8: Request processed in 873us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403211.557009:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784403211.557064:0:3564:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48972300 x1871082260813440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784403221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403211.557077:0:3564:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784403211.557087:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784403211.557098:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784403211.557105:0:3564:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784403211.557120:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a453ba800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784403211.557141:0:3564:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784403211.557146:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260813440:0@lo:8: 00000004:00080000:1.0:1784403211.557181:0:8233:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784403211.557311:0:8233:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 217125443935ns, next at 0ns, rc = 0 00000020:01000000:2.0:1784403211.559089:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1784403211.559126:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784403211.559138:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.559153:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403211.559164:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784403211.559166:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c8a526f8000 from 1 10000000:01000000:2.0:1784403211.559169:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784403211.559216:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.559224:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.559235:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403211.559264:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260813696:0@lo:101: 00000100:00100000:2.0:1784403211.559337:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.559389:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.559412:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260813696 00000100:00100000:2.0:1784403211.559421:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260813696 00000100:00100000:2.0:1784403211.559473:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784403211.559483:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260813696:12345-0@lo:101: 00010000:00010000:2.0:1784403211.559501:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403211.559522:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a5b67a800/0x6828175665afa67a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa673 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.559552:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a5b67a800/0x6828175665afa67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa673 expref: 19 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.559564:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a5b67a800/0x6828175665afa67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa673 expref: 19 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.559574:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a5b67a800, rc 0) 00000100:00100000:2.0:1784403211.559622:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260813696:12345-0@lo:101: Request processed in 140us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403211.559628:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784403211.559672:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260813696:0@lo:101: 00010000:00010000:2.0:1784403211.559688:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.559698:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403211.562018:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260813824:0@lo:501: 00000100:00100000:2.0:1784403211.562097:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403211.562154:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403211.562185:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260813824 00000100:00100000:2.0:1784403211.562193:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260813824 00000100:00100000:2.0:1784403211.562244:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784403211.562252:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260813824:12345-0@lo:501: 00000100:00100000:2.0:1784403211.562550:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260813824:12345-0@lo:501: Request processed in 296us (451us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784403211.562566:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784403211.562620:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260813824:0@lo:501: 10000000:01000000:2.0:1784403211.562656:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784403211.562666:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403211.562679:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784403211.645119:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1784403211.740470:0:8234:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1784403211.740508:0:8234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8234:1871082260814080:0@lo:7: 00000100:00100000:1.0:1784403211.740595:0:8234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403211.744041:0:8234:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce000 going to sleep for 11 seconds 00000100:00100000:1.0:1784403211.744086:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260813952:0@lo:13: 00000100:00100000:1.0:1784403211.744185:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403211.744285:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260814080 00000100:00100000:1.0:1784403211.744297:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260814080 00000100:00080000:2.0:1784403211.744418:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784403211.744739:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260813952 00000100:00100000:0.0:1784403211.744745:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260813952 00000100:00100000:0.0:1784403211.744795:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784403211.744817:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3565:x1871082260813952:12345-0@lo:13: 00002000:00000024:0.0:1784403211.744908:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1784403211.745001:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3565:x1871082260813952:12345-0@lo:13: Request processed in 186us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403211.745010:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784403211.745052:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7fec4380 x1871082260813952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403211.745074:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260813952:0@lo:13: 00000100:00100000:1.0:1784403211.746790:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784403211.747012:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8234:x1871082260814080:12345-0@lo:7: 00002000:00080000:1.0:1784403211.760636:0:7102:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1784403211.760649:0:7102:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1784403211.761233:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8234:x1871082260814080:12345-0@lo:7: Request processed in 14223us (20629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403211.761248:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1784403211.761410:0:8234:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7fec4700 x1871082260814080/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784403227 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403211.761429:0:8234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8234:1871082260814080:0@lo:7: 00000004:00080000:3.0:1784403211.761448:0:8234:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1784403211.761503:0:8234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8234:1871082260814208:0@lo:5: 00000100:00100000:3.0:1784403211.761551:0:8234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403211.761618:0:8234:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2f600 going to sleep for 11 seconds 00000100:00100000:1.0:1784403211.761728:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260814208 00000100:00100000:1.0:1784403211.761745:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260814208 00000100:00100000:1.0:1784403211.762058:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403211.762071:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8234:x1871082260814208:12345-0@lo:5: 00002000:00080000:1.0:1784403211.762107:0:7101:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1784403211.762112:0:7101:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1784403211.762511:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8234:x1871082260814208:12345-0@lo:5: Request processed in 442us (958us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784403211.762534:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1784403211.762647:0:8234:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a81b58000 x1871082260814208/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784403227 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403211.762664:0:8234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8234:1871082260814208:0@lo:5: 00000004:00080000:3.0:1784403211.762678:0:8234:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1784403211.762718:0:8234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8234:1871082260814336:0@lo:700: 00000100:00100000:3.0:1784403211.762765:0:8234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403211.763511:0:8234:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f2f600 going to sleep for 11 seconds 00000100:00100000:1.0:1784403211.763710:0:7108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260814336 00000100:00100000:1.0:1784403211.763719:0:7108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260814336 00000100:00100000:1.0:1784403211.763926:0:7108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784403211.763939:0:7108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8234:x1871082260814336:12345-0@lo:700: 00000100:00100000:1.0:1784403211.764004:0:7108:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:7108:1871082260814464:0@lo:700: 00000100:00100000:1.0:1784403211.764052:0:7108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403211.764077:0:7108:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410cea80 going to sleep for 11 seconds 00000100:00100000:1.0:1784403211.764102:0:6299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260814464 00000100:00100000:1.0:1784403211.764105:0:6299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260814464 00000100:00100000:1.0:1784403211.764136:0:6299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784403211.764143:0:6299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7108:x1871082260814464:12345-0@lo:700: 40000000:02000000:1.0:1784403211.826360:0:6299:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1784403211.842301:0:6299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7108:x1871082260814464:12345-0@lo:700: Request processed in 78144us (78234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403211.842321:0:6299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784403211.843759:0:7108:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7fec6680 x1871082260814464/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784403227 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403211.843782:0:7108:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:7108:1871082260814464:0@lo:700: 40000000:02000000:2.0:1784403211.843800:0:7108:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1784403211.953902:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1784403211.953934:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784403211.954266:0:7108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8234:x1871082260814336:12345-0@lo:700: Request processed in 190322us (191491us total) trans 0 rc 0/0 00010000:00080000:2.0:1784403211.954361:0:8234:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a81b5ad80 x1871082260814336/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784403227 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403211.954376:0:8234:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1784403211.954400:0:8234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8234:1871082260814336:0@lo:700: 00000100:00100000:3.0:1784403211.954821:0:7108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:02000040:0.0:1784403212.041432:0:8234:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1784403212.053469:0:8234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8234:1871082260814592:0@lo:5: 00000100:00100000:0.0:1784403212.053564:0:8234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403212.053655:0:8234:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d56600 going to sleep for 11 seconds 00000100:00100000:0.0:1784403212.056745:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260814592 00000100:00100000:0.0:1784403212.056769:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260814592 00000100:00100000:0.0:1784403212.056860:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784403212.056894:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8234:x1871082260814592:12345-0@lo:5: 00002000:00080000:1.0:1784403212.076236:0:7102:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1784403212.076269:0:7102:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1784403212.081827:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8234:x1871082260814592:12345-0@lo:5: Request processed in 24926us (28253us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784403212.081846:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784403212.082234:0:8234:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a4302ea00 x1871082260814592/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784403228 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403212.082258:0:8234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8234:1871082260814592:0@lo:5: 00000004:00080000:1.0:1784403212.082278:0:8234:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1784403212.131056:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403213.160003:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784403214.025044:0:8352:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784403214.175299:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403214.559668:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260814720:0@lo:13: 00000100:00100000:3.0:1784403214.559784:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403214.560126:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260814720 00000100:00100000:2.0:1784403214.560139:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260814720 00000100:00100000:2.0:1784403214.560222:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784403214.560237:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260814720:12345-0@lo:13: 00002000:00000024:2.0:1784403214.560307:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403214.560372:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260814720:12345-0@lo:13: Request processed in 137us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403214.560381:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784403214.560431:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48972a00 x1871082260814720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403214.560452:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260814720:0@lo:13: 00000100:00080000:3.0:1784403214.560559:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784403215.207179:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403216.226122:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403216.608983:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260814976:0@lo:400: 00000100:00100000:1.0:1784403216.608998:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260814848:0@lo:400: 00000100:00100000:2.0:1784403216.609128:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260815104:0@lo:400: 00000100:00100000:3.0:1784403216.614414:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260815232:0@lo:400: 00000100:00100000:0.0:1784403216.614798:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403216.614929:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260815488:0@lo:400: 00000100:00100000:0.0:1784403216.614976:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403216.615033:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260814976 00000100:00100000:0.0:1784403216.615044:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260814976 00000100:00100000:0.0:1784403216.615108:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784403216.615118:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260814976:12345-0@lo:400: 00000100:00100000:0.0:1784403216.615189:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260814976:12345-0@lo:400: Request processed in 70us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403216.615196:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1784403216.615255:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a81b58000 x1871082260814976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403216.615275:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260814976:0@lo:400: 00000100:00100000:0.0:1784403216.615460:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260815488 00000100:00100000:0.0:1784403216.615464:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260815488 00000100:00100000:0.0:1784403216.615535:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784403216.615542:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3568:x1871082260815488:12345-0@lo:400: 00000100:00100000:0.0:1784403216.615583:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3568:x1871082260815488:12345-0@lo:400: Request processed in 42us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403216.615589:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1784403216.615605:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784403216.615627:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd6680 x1871082260815488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403216.615639:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260815488:0@lo:400: 00000100:00100000:1.0:1784403216.619555:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403216.619646:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260815360:0@lo:400: 00000100:00100000:1.0:1784403216.619714:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403216.619789:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260815360 00000100:00100000:1.0:1784403216.619798:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260815360 00000100:00100000:1.0:1784403216.619893:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784403216.619918:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260815360:12345-0@lo:400: 00000100:00100000:1.0:1784403216.619985:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260815360:12345-0@lo:400: Request processed in 70us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403216.619994:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1784403216.620018:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784403216.620056:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd5880 x1871082260815360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403216.620073:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260815360:0@lo:400: 00000100:00100000:0.0:1784403216.620344:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260814848 00000100:00100000:0.0:1784403216.620350:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260814848 00000100:00100000:0.0:1784403216.620394:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784403216.620402:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260814848:12345-0@lo:400: 00000100:00100000:0.0:1784403216.620466:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260814848:12345-0@lo:400: Request processed in 64us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403216.620474:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784403216.621013:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260814848:0@lo:400: 00000100:00100000:2.0:1784403216.622717:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403216.623116:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260815104 00000100:00100000:0.0:1784403216.623127:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260815104 00000100:00100000:0.0:1784403216.623225:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784403216.623236:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260815104:12345-0@lo:400: 00000100:00100000:0.0:1784403216.623319:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260815104:12345-0@lo:400: Request processed in 85us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403216.623327:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1784403216.623427:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd4700 x1871082260815104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403216.623443:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260815104:0@lo:400: 00000100:00080000:1.0:1784403216.624091:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403216.624201:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403216.624306:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260815232 00000100:00100000:0.0:1784403216.624312:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260815232 00000100:00100000:0.0:1784403216.624408:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784403216.624417:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260815232:12345-0@lo:400: 00000100:00100000:0.0:1784403216.626157:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260815232:12345-0@lo:400: Request processed in 1731us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403216.626173:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784403216.626660:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd7800 x1871082260815232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403216.626677:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260815232:0@lo:400: 00000100:00080000:1.0:1784403216.628745:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403217.124431:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260815616:0@lo:13: 00000100:00100000:2.0:1784403217.124524:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403217.124616:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260815616 00000100:00100000:2.0:1784403217.124625:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260815616 00000100:00100000:2.0:1784403217.124814:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784403217.124829:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260815616:12345-0@lo:13: 00002000:00000024:2.0:1784403217.124903:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403217.124968:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260815616:12345-0@lo:13: Request processed in 142us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403217.125001:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784403217.125051:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48973100 x1871082260815616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403217.125071:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260815616:0@lo:13: 00000001:00080000:1.0:1784403217.198620:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1784403217.259024:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403218.271952:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403219.301981:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403219.679288:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260815744:0@lo:13: 00000100:00100000:2.0:1784403219.679390:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403219.679538:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260815744 00000100:00100000:3.0:1784403219.679549:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260815744 00000100:00100000:3.0:1784403219.679641:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784403219.679655:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260815744:12345-0@lo:13: 00002000:00000024:3.0:1784403219.679701:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403219.679764:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260815744:12345-0@lo:13: Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403219.679772:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1784403219.679823:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd4e00 x1871082260815744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403219.679856:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260815744:0@lo:13: 00000100:00080000:2.0:1784403219.679999:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784403220.319279:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403220.994904:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403220.996139:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240868736 00000100:00100000:2.0:1784403220.996160:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240868736 00000100:00100000:2.0:1784403220.996242:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:2.0:1784403220.996254:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1871082240868736:12345-192.168.204.28@tcp:250: 00010000:00080000:2.0:1784403220.996295:0:6285:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 19cbaa0a-7e67-4763-bd2a-e7951d0c18e7@192.168.204.28@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:2.0:1784403220.996339:0:6285:0:(genops.c:1385:class_connect()) connect: client 19cbaa0a-7e67-4763-bd2a-e7951d0c18e7, cookie 0x6828175665afa681 00000100:00080000:2.0:1784403220.996501:0:6285:0:(import.c:65:import_set_state_nolock()) ffff8c8a77cf5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784403220.996671:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+5:2357:x1871082240868736:12345-192.168.204.28@tcp:250: Request processed in 416us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403220.996680:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:1.0:1784403221.019446:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403221.024520:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240868608 00000100:00100000:2.0:1784403221.024542:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240868608 00000100:00100000:2.0:1784403221.024768:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:2.0:1784403221.024783:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+5:5562:x1871082240868608:12345-192.168.204.28@tcp:101: 00010000:00010000:2.0:1784403221.024826:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403221.025150:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a5b67b000/0x6828175665afa688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890e999 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403221.025197:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a5b67b000/0x6828175665afa688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e999 expref: 6 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403221.025212:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a5b67b000/0x6828175665afa688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e999 expref: 6 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403221.025223:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a5b67b000, rc 0) 00000100:00100000:2.0:1784403221.025315:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+6:5562:x1871082240868608:12345-192.168.204.28@tcp:101: Request processed in 534us (5882us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403221.025323:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:1.0:1784403221.028555:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403221.028674:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240868864 00000100:00100000:0.0:1784403221.028692:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240868864 00000100:00100000:0.0:1784403221.028775:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:0.0:1784403221.028787:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+6:5562:x1871082240868864:12345-192.168.204.28@tcp:501: 00000100:00100000:0.0:1784403221.029625:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+6:5562:x1871082240868864:12345-192.168.204.28@tcp:501: Request processed in 833us (1081us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784403221.029635:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:0.0:1784403221.039962:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403221.040142:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240868992 00000100:00100000:2.0:1784403221.040155:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240868992 00000100:00100000:2.0:1784403221.040219:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:2.0:1784403221.040230:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+6:5562:x1871082240868992:12345-192.168.204.28@tcp:101: 00010000:00010000:2.0:1784403221.040248:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403221.040268:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a5b67b800/0x6828175665afa68f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890e9a0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403221.040296:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a5b67b800/0x6828175665afa68f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9a0 expref: 7 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403221.040307:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a5b67b800/0x6828175665afa68f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9a0 expref: 7 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403221.040316:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a5b67b800, rc 0) 00000100:00100000:2.0:1784403221.040381:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+7:5562:x1871082240868992:12345-192.168.204.28@tcp:101: Request processed in 153us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403221.040403:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:1.0:1784403221.045627:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403221.047279:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240869120 00000100:00100000:0.0:1784403221.047295:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240869120 00000100:00100000:0.0:1784403221.047366:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:0.0:1784403221.047377:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+7:5562:x1871082240869120:12345-192.168.204.28@tcp:501: 00000100:00100000:0.0:1784403221.047752:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:5562:x1871082240869120:12345-192.168.204.28@tcp:501: Request processed in 374us (2948us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403221.047761:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:1.0:1784403221.050642:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403221.050848:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240869248 00000100:00100000:3.0:1784403221.050861:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240869248 00000100:00100000:3.0:1784403221.050952:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:3.0:1784403221.050963:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:5562:x1871082240869248:12345-192.168.204.28@tcp:503: 00000100:00100000:3.0:1784403221.051379:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:5562:x1871082240869248:12345-192.168.204.28@tcp:503: Request processed in 416us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403221.051388:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:1.0:1784403221.061909:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403221.062151:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240869376 00000100:00100000:2.0:1784403221.062163:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240869376 00000100:00100000:2.0:1784403221.062224:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 119 00000100:00100000:2.0:1784403221.062234:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:5580:x1871082240869376:12345-192.168.204.28@tcp:502: 00000100:00100000:2.0:1784403221.062657:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:5580:x1871082240869376:12345-192.168.204.28@tcp:502: Request processed in 423us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403221.062666:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 119 00000100:00100000:2.0:1784403221.105929:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403221.106034:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240869504 00000100:00100000:0.0:1784403221.106045:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240869504 00000100:00100000:0.0:1784403221.106105:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:0.0:1784403221.106116:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:5580:x1871082240869504:12345-192.168.204.28@tcp:502: 00000100:00100000:0.0:1784403221.106409:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:5580:x1871082240869504:12345-192.168.204.28@tcp:502: Request processed in 294us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403221.106418:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:1.0:1784403221.113014:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403221.113183:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240869632 00000100:00100000:3.0:1784403221.113194:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240869632 00000100:00100000:3.0:1784403221.113260:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:3.0:1784403221.113271:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:5562:x1871082240869632:12345-192.168.204.28@tcp:101: 00010000:00010000:3.0:1784403221.113290:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403221.113309:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afa696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890e9ca expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403221.113360:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afa696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9ca expref: 9 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403221.113374:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afa696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9ca expref: 9 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403221.113384:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6a00, rc 0) 00000100:00100000:3.0:1784403221.113475:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5562:x1871082240869632:12345-192.168.204.28@tcp:101: Request processed in 205us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403221.113484:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:1.0:1784403221.118952:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403221.119353:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240869760 00000100:00100000:2.0:1784403221.119365:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240869760 00000100:00100000:2.0:1784403221.119426:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:2.0:1784403221.119446:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5562:x1871082240869760:12345-192.168.204.28@tcp:256: 20000000:01000000:2.0:1784403221.119474:0:6286:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784403221.119514:0:6286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784403221.119519:0:6286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784403221.119522:0:6286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784403221.119525:0:6286:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1784403221.125926:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5562:x1871082240869760:12345-192.168.204.28@tcp:256: Request processed in 6476us (6970us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403221.125954:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:1.0:1784403221.141524:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403221.141914:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240869888 00000100:00100000:0.0:1784403221.141928:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240869888 00000100:00100000:0.0:1784403221.141993:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:0.0:1784403221.142014:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5562:x1871082240869888:12345-192.168.204.28@tcp:101: 00010000:00010000:0.0:1784403221.142033:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403221.142055:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a40030400/0x6828175665afa69d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890e9d1 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403221.142087:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a40030400/0x6828175665afa69d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9d1 expref: 10 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403221.142100:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a40030400/0x6828175665afa69d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9d1 expref: 10 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403221.142109:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40030400, rc 0) 00000100:00100000:0.0:1784403221.142187:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5562:x1871082240869888:12345-192.168.204.28@tcp:101: Request processed in 175us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403221.142194:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:0.0:1784403221.150810:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403221.151092:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240870016 00000100:00100000:1.0:1784403221.151105:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240870016 00000100:00100000:1.0:1784403221.151158:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 124 00000100:00100000:1.0:1784403221.151169:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5562:x1871082240870016:12345-192.168.204.28@tcp:501: 00000100:00100000:1.0:1784403221.151914:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5562:x1871082240870016:12345-192.168.204.28@tcp:501: Request processed in 740us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403221.151926:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 124 00000100:00100000:2.0:1784403221.164858:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403221.164978:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240870144 00000100:00100000:3.0:1784403221.164989:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240870144 00000100:00100000:3.0:1784403221.165059:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:3.0:1784403221.165070:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5562:x1871082240870144:12345-192.168.204.28@tcp:503: 00000100:00100000:3.0:1784403221.165476:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5562:x1871082240870144:12345-192.168.204.28@tcp:503: Request processed in 406us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403221.165485:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:2.0:1784403221.176401:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403221.176751:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240870272 00000100:00100000:0.0:1784403221.176763:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240870272 00000100:00100000:0.0:1784403221.176830:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:0.0:1784403221.176843:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49cf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5584:x1871082240870272:12345-192.168.204.28@tcp:502: 00000100:00100000:0.0:1784403221.177303:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49cf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5584:x1871082240870272:12345-192.168.204.28@tcp:502: Request processed in 461us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403221.177311:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:0.0:1784403221.185461:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403221.185678:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240870400 00000100:00100000:1.0:1784403221.185696:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240870400 00000100:00100000:1.0:1784403221.185924:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 127 00000100:00100000:1.0:1784403221.185936:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49cf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5584:x1871082240870400:12345-192.168.204.28@tcp:502: 00000100:00100000:1.0:1784403221.186227:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49cf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5584:x1871082240870400:12345-192.168.204.28@tcp:502: Request processed in 292us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403221.186236:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 127 00000100:00100000:2.0:1784403221.195419:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403221.195580:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240870528 00000100:00100000:1.0:1784403221.195600:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240870528 00000100:00100000:1.0:1784403221.195716:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:1.0:1784403221.195726:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1871082240870528:12345-192.168.204.28@tcp:38: 00010000:00080000:1.0:1784403221.195768:0:6294:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1784403221.195836:0:6294:0:(genops.c:1385:class_connect()) connect: client becd6ccb-dd35-46e6-9ecf-44ee31a105f1, cookie 0x6828175665afa6a4 00000004:00100000:1.0:1784403221.195916:0:6294:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1784403221.195924:0:6294:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1784403221.228991:0:6294:0:(import.c:65:import_set_state_nolock()) ffff8c8a72e4e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784403221.229113:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2357:x1871082240870528:12345-192.168.204.28@tcp:38: Request processed in 33384us (33702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403221.229126:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00010000:00010000:2.0:1784403221.343099:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403221.727207:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260816128:0@lo:400: 00000100:00100000:3.0:1784403221.727284:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403221.727288:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260816256:0@lo:400: 00000100:00100000:0.0:1784403221.727349:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403221.727368:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260816000:0@lo:400: 00000100:00100000:0.0:1784403221.727383:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260816256 00000100:00100000:0.0:1784403221.727390:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260816256 00000100:00100000:3.0:1784403221.727393:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403221.727411:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260816512:0@lo:400: 00000100:00100000:3.0:1784403221.727432:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403221.727440:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260816512 00000100:00100000:0.0:1784403221.727443:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260816512 00000100:00100000:3.0:1784403221.727452:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784403221.727457:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260815872:0@lo:400: 00000100:00100000:0.0:1784403221.727461:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784403221.727470:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260816256:12345-0@lo:400: 00000100:00100000:3.0:1784403221.727492:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403221.727514:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260816384:0@lo:400: 00000100:00100000:3.0:1784403221.727532:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403221.727535:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260816256:12345-0@lo:400: Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403221.727555:0:7099:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1784403221.727556:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784403221.727564:0:7099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1784403221.727573:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784403221.727579:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260816512:12345-0@lo:400: 00000100:00100000:0.0:1784403221.727618:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260816512:12345-0@lo:400: Request processed in 40us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403221.727625:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784403221.727644:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260815872 00000100:00100000:0.0:1784403221.727647:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260815872 00000100:00100000:0.0:1784403221.727671:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784403221.727677:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260815872:12345-0@lo:400: 00000100:00100000:0.0:1784403221.727707:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260815872:12345-0@lo:400: Request processed in 30us (214us total) trans 0 rc 0/0 00010000:00080000:3.0:1784403221.727711:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a4302ed80 x1871082260816512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403221.727713:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784403221.727722:0:3568:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784403221.727737:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260816512:0@lo:400: 00010000:00080000:0.0:1784403221.727746:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a4302c000 x1871082260816256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403221.727750:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260815872:0@lo:400: 00000100:00100000:0.0:1784403221.727755:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260816256:0@lo:400: 00000100:00100000:3.0:1784403221.727765:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260816128 00000100:00100000:3.0:1784403221.727769:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260816128 00000100:00100000:3.0:1784403221.727792:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260816000 00000100:00100000:3.0:1784403221.727795:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260816000 00000100:00100000:3.0:1784403221.727818:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260816384 00000100:00100000:3.0:1784403221.727822:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260816384 00000100:00100000:3.0:1784403221.727837:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784403221.727843:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260816128:12345-0@lo:400: 00000100:00100000:3.0:1784403221.727923:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260816128:12345-0@lo:400: Request processed in 79us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403221.728012:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784403221.728029:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784403221.728036:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260816000:12345-0@lo:400: 00010000:00080000:0.0:1784403221.728215:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a4302f480 x1871082260816128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403221.728238:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260816128:0@lo:400: 00000100:00100000:3.0:1784403221.728479:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260816000:12345-0@lo:400: Request processed in 442us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403221.728486:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784403221.728506:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784403221.728513:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260816384:12345-0@lo:400: 00000100:00100000:3.0:1784403221.728547:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260816384:12345-0@lo:400: Request processed in 35us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403221.728553:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1784403221.728895:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a4302e300 x1871082260816384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403221.728909:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260816384:0@lo:400: 00010000:00080000:3.0:1784403221.728924:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a4302f100 x1871082260816000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403221.728932:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260816000:0@lo:400: 00000100:00080000:3.0:1784403221.729163:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784403221.729171:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784403221.729173:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403222.239391:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784403222.239423:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48970700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260816640:0@lo:13: 00000100:00100000:1.0:1784403222.239535:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403222.240115:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260816640 00000100:00100000:3.0:1784403222.240124:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260816640 00000100:00100000:3.0:1784403222.240180:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784403222.240190:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260816640:12345-0@lo:13: 00002000:00000024:3.0:1784403222.240229:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403222.240299:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260816640:12345-0@lo:13: Request processed in 110us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403222.240306:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1784403222.240980:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48970700 x1871082260816640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403222.241004:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48970700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260816640:0@lo:13: 00000100:00100000:2.0:1784403222.252437:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403222.252492:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403222.252814:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240870784 00000100:00100000:3.0:1784403222.252825:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240870784 00000100:00100000:3.0:1784403222.252927:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240870656 00000100:00100000:3.0:1784403222.252930:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240870656 00000100:00100000:3.0:1784403222.252953:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:3.0:1784403222.252975:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:5562:x1871082240870784:12345-192.168.204.28@tcp:41: 00000004:00000024:3.0:1784403222.253030:0:6292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784403222.253101:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:5562:x1871082240870784:12345-192.168.204.28@tcp:41: Request processed in 128us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403222.253109:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:3.0:1784403222.253127:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:3.0:1784403222.253134:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:0:x1871082240870656:12345-192.168.204.28@tcp:41: 00000004:00000024:3.0:1784403222.253144:0:6292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784403222.253164:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:0:x1871082240870656:12345-192.168.204.28@tcp:41: Request processed in 31us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403222.253169:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00080000:2.0:1784403222.253946:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403222.271858:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403222.272529:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240870912 00000100:00100000:3.0:1784403222.272541:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240870912 00000100:00100000:3.0:1784403222.272853:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:3.0:1784403222.272895:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:5562:x1871082240870912:12345-192.168.204.28@tcp:40: 00000100:00100000:3.0:1784403222.272994:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:5562:x1871082240870912:12345-192.168.204.28@tcp:40: Request processed in 130us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403222.273001:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1784403222.277198:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403222.277267:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403222.277406:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240871040 00000100:00100000:3.0:1784403222.277417:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240871040 00000100:00100000:3.0:1784403222.277463:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1784403222.277472:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1871082240871040:12345-192.168.204.28@tcp:8: 00010000:00080000:3.0:1784403222.277519:0:7099:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1784403222.277554:0:7099:0:(genops.c:1385:class_connect()) connect: client becd6ccb-dd35-46e6-9ecf-44ee31a105f1, cookie 0x6828175665afa6ab 00002000:00100000:3.0:1784403222.277567:0:7099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli becd6ccb-dd35-46e6-9ecf-44ee31a105f1/ffff8c8a453bd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784403222.277853:0:7099:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784403222.278277:0:7099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784403222.278313:0:7099:0:(import.c:65:import_set_state_nolock()) ffff8c8a453be000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784403222.278380:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2357:x1871082240871040:12345-192.168.204.28@tcp:8: Request processed in 906us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403222.278388:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:1.0:1784403222.278911:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240871296 00000100:00100000:1.0:1784403222.278919:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240871296 00000100:00100000:1.0:1784403222.278965:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 129 00000100:00100000:1.0:1784403222.278974:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240871296:12345-192.168.204.28@tcp:400: 00000100:00100000:1.0:1784403222.279023:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240871296:12345-192.168.204.28@tcp:400: Request processed in 50us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403222.279030:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 129 00000100:00100000:2.0:1784403222.281815:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403222.281915:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240871168 00000100:00100000:0.0:1784403222.281925:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240871168 00000100:00100000:0.0:1784403222.281977:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:0.0:1784403222.281986:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1871082240871168:12345-192.168.204.28@tcp:8: 00010000:00080000:0.0:1784403222.282032:0:7102:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:0.0:1784403222.282064:0:7102:0:(genops.c:1385:class_connect()) connect: client becd6ccb-dd35-46e6-9ecf-44ee31a105f1, cookie 0x6828175665afa6b2 00002000:00100000:0.0:1784403222.282077:0:7102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli becd6ccb-dd35-46e6-9ecf-44ee31a105f1/ffff8c8a77d53800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784403222.282089:0:7102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784403222.282455:0:7102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784403222.282490:0:7102:0:(import.c:65:import_set_state_nolock()) ffff8c8a77d55800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784403222.282759:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2357:x1871082240871168:12345-192.168.204.28@tcp:8: Request processed in 771us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403222.282767:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:2.0:1784403222.284784:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403222.284941:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240871424 00000100:00100000:1.0:1784403222.284952:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240871424 00000100:00100000:1.0:1784403222.285080:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:1.0:1784403222.285093:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:5562:x1871082240871424:12345-192.168.204.28@tcp:33: 00000004:00080000:1.0:1784403222.309916:0:6295:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24743us 00000004:00200000:1.0:1784403222.325215:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1784403222.325455:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:5562:x1871082240871424:12345-192.168.204.28@tcp:33: Request processed in 40356us (40673us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403222.325470:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00010000:00010000:2.0:1784403222.367919:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403222.559325:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403222.559627:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240871552 00000100:00100000:0.0:1784403222.559637:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240871552 00000100:00100000:0.0:1784403222.559709:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:0.0:1784403222.559720:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:5601:x1871082240871552:12345-192.168.204.28@tcp:101: 00010000:00010000:0.0:1784403222.559744:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403222.559772:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031e00/0x6828175665afa6b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890e9fb expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403222.559857:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afa6c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403222.559924:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afa6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403222.559941:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afa6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403222.560183:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1784403222.560188:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403222.560268:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afa6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403222.560296:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031e00/0x6828175665afa6b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9fb expref: 8 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403222.560317:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afa6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9fb expref: 7 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403222.560327:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:0.0:1784403222.560330:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403222.560333:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40030800, rc 0) 00000100:00100000:0.0:1784403222.560402:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:5601:x1871082240871552:12345-192.168.204.28@tcp:101: Request processed in 684us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403222.560409:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00010000:00010000:2.0:1784403223.391120:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403224.415104:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403224.799131:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784403224.799165:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260816768:0@lo:13: 00000100:00100000:0.0:1784403224.799256:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403224.799658:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260816768 00000100:00100000:3.0:1784403224.799668:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260816768 00000100:00100000:3.0:1784403224.799770:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784403224.799784:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260816768:12345-0@lo:13: 00002000:00000024:3.0:1784403224.799832:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403224.799927:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260816768:12345-0@lo:13: Request processed in 147us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403224.799936:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1784403224.799982:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd6a00 x1871082260816768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403224.800003:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260816768:0@lo:13: 00000100:00080000:2.0:1784403224.800088:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403224.862838:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403224.863092:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240871680 00000100:00100000:3.0:1784403224.863106:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240871680 00000100:00100000:3.0:1784403224.863201:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:3.0:1784403224.863215:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:5654:x1871082240871680:12345-192.168.204.28@tcp:41: 00000004:00000024:3.0:1784403224.863277:0:6292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784403224.863484:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:5654:x1871082240871680:12345-192.168.204.28@tcp:41: Request processed in 270us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403224.863492:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00080000:2.0:1784403224.864077:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403224.876301:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403224.876401:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240871808 00000100:00100000:3.0:1784403224.876434:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240871808 00000100:00100000:3.0:1784403224.876546:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:3.0:1784403224.876559:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:5654:x1871082240871808:12345-192.168.204.28@tcp:13: 00002000:00000024:3.0:1784403224.876594:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403224.876690:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:5654:x1871082240871808:12345-192.168.204.28@tcp:13: Request processed in 132us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403224.876698:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00080000:2.0:1784403224.876828:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403224.888656:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403224.888784:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240871936 00000100:00100000:3.0:1784403224.888798:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240871936 00000100:00100000:3.0:1784403224.888913:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:3.0:1784403224.888929:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:5654:x1871082240871936:12345-192.168.204.28@tcp:13: 00002000:00000024:3.0:1784403224.888988:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403224.889081:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:5654:x1871082240871936:12345-192.168.204.28@tcp:13: Request processed in 157us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403224.889089:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00080000:2.0:1784403224.890031:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784403225.439194:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784403225.912025:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000001:00100000:1.0:1784403225.952594:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000001:00100000:3.0:1784403226.423634:0:6314:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00010000:00010000:2.0:1784403226.465565:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403226.847408:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260817280:0@lo:400: 00000100:00100000:1.0:1784403226.847605:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260816896:0@lo:400: 00000100:00100000:1.0:1784403226.847672:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403226.847743:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260817408:0@lo:400: 00000100:00100000:1.0:1784403226.847773:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403226.847806:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784403226.847811:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260817024:0@lo:400: 00000100:00100000:1.0:1784403226.847832:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403226.847845:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260817536:0@lo:400: 00000100:00100000:1.0:1784403226.847890:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403226.847929:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260817408 00000100:00100000:1.0:1784403226.847939:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260817408 00000100:00100000:1.0:1784403226.848004:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260817024 00000100:00100000:1.0:1784403226.848007:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260817024 00000100:00100000:1.0:1784403226.848027:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784403226.848038:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260817408:12345-0@lo:400: 00000100:00100000:1.0:1784403226.848096:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260817408:12345-0@lo:400: Request processed in 60us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403226.848104:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784403226.848123:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784403226.848129:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260817024:12345-0@lo:400: 00000100:00100000:1.0:1784403226.848154:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260817024:12345-0@lo:400: Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403226.848161:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784403226.848200:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260817024:0@lo:400: 00000100:00100000:1.0:1784403226.848213:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260817408:0@lo:400: 00000100:00100000:2.0:1784403226.848312:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260817152:0@lo:400: 00000100:00100000:2.0:1784403226.848345:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784403226.848384:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403226.848414:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260817536 00000100:00100000:2.0:1784403226.848418:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260817536 00000100:00100000:2.0:1784403226.848457:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784403226.848465:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260817536:12345-0@lo:400: 00000100:00100000:2.0:1784403226.848523:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260817536:12345-0@lo:400: Request processed in 59us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403226.848530:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1784403226.848545:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784403226.848563:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd4000 x1871082260817536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403226.848575:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260817536:0@lo:400: 00000100:00100000:2.0:1784403226.848626:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260817152 00000100:00100000:2.0:1784403226.848630:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260817152 00000100:00100000:2.0:1784403226.848657:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784403226.848664:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260817152:12345-0@lo:400: 00000100:00100000:2.0:1784403226.848699:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260817152:12345-0@lo:400: Request processed in 36us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403226.848716:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1784403226.848732:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403226.848750:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260817152:0@lo:400: 00000100:00100000:0.0:1784403226.848995:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260816896 00000100:00100000:0.0:1784403226.849008:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260816896 00000100:00100000:0.0:1784403226.849051:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784403226.849059:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260816896:12345-0@lo:400: 00000100:00100000:0.0:1784403226.849110:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260816896:12345-0@lo:400: Request processed in 52us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403226.849116:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784403226.849164:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260816896:0@lo:400: 00000100:00100000:3.0:1784403226.850301:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403226.850906:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260817280 00000100:00100000:0.0:1784403226.850916:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260817280 00000100:00100000:0.0:1784403226.850980:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784403226.850991:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260817280:12345-0@lo:400: 00000100:00100000:0.0:1784403226.851064:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260817280:12345-0@lo:400: Request processed in 77us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403226.851070:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1784403226.851141:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784403226.851219:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd5500 x1871082260817280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403226.851253:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260817280:0@lo:400: 00000100:00100000:0.0:1784403227.361098:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260817664:0@lo:13: 00000100:00100000:0.0:1784403227.361234:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403227.361345:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260817664 00000100:00100000:1.0:1784403227.361356:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260817664 00000100:00100000:1.0:1784403227.361435:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784403227.361448:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260817664:12345-0@lo:13: 00002000:00000024:1.0:1784403227.361499:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403227.367315:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260817664:12345-0@lo:13: Request processed in 5853us (6066us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403227.367335:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1784403227.368013:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a58092a00 x1871082260817664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403227.368047:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260817664:0@lo:13: 00010000:00010000:2.0:1784403227.488751:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403227.709539:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403227.709665:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240872064 00000100:00100000:0.0:1784403227.709678:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240872064 00000100:00100000:0.0:1784403227.709762:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 131 00000100:00100000:0.0:1784403227.709774:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2359:x1871082240872064:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1784403227.717308:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2359:x1871082240872064:12345-192.168.204.28@tcp:400: Request processed in 7516us (7763us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403227.717327:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 131 00000100:00100000:1.0:1784403227.717935:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403227.718009:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403227.718044:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403227.718430:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240872192 00000100:00100000:0.0:1784403227.718441:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240872192 00000100:00100000:0.0:1784403227.718524:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:0.0:1784403227.718535:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2359:x1871082240872192:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1784403227.718764:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2359:x1871082240872192:12345-192.168.204.28@tcp:400: Request processed in 231us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403227.718772:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:0.0:1784403227.718799:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240872320 00000100:00100000:0.0:1784403227.718804:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240872320 00000100:00100000:0.0:1784403227.718831:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240872448 00000100:00100000:0.0:1784403227.718834:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240872448 00000100:00100000:0.0:1784403227.718855:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1784403227.718862:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240872320:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1784403227.718922:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240872320:12345-192.168.204.28@tcp:400: Request processed in 60us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403227.718928:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1784403227.719126:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:0.0:1784403227.719136:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240872448:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1784403227.719168:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240872448:12345-192.168.204.28@tcp:400: Request processed in 34us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403227.719342:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00080000:3.0:1784403227.720598:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784403227.720608:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784403227.720612:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1784403228.495069:0:8659:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1784403228.512066:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403229.536152:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403229.922620:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260817792:0@lo:13: 00000100:00100000:3.0:1784403229.922809:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403229.923017:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260817792 00000100:00100000:2.0:1784403229.923028:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260817792 00000100:00100000:2.0:1784403229.923108:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784403229.923121:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260817792:12345-0@lo:13: 00002000:00000024:2.0:1784403229.923171:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403229.923240:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260817792:12345-0@lo:13: Request processed in 122us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403229.923248:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1784403229.923315:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784403229.923525:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a58091c00 x1871082260817792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403229.923546:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260817792:0@lo:13: 00010000:00010000:0.0:1784403230.559333:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403231.588082:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403231.969143:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260818048:0@lo:400: 00000100:00100000:3.0:1784403231.969274:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403231.969357:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260818560:0@lo:400: 00000100:00100000:3.0:1784403231.969387:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403231.969425:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784403231.969431:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260817920:0@lo:400: 00000100:00100000:3.0:1784403231.969463:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403231.969487:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260818432:0@lo:400: 00000100:00100000:3.0:1784403231.969510:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403231.969555:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260818048 00000100:00100000:3.0:1784403231.969566:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260818048 00000100:00100000:3.0:1784403231.969631:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260818432 00000100:00100000:3.0:1784403231.969635:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260818432 00000100:00100000:3.0:1784403231.969665:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784403231.969675:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260818048:12345-0@lo:400: 00000100:00100000:3.0:1784403231.969731:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260818048:12345-0@lo:400: Request processed in 57us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403231.969738:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784403231.969756:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784403231.969762:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260818432:12345-0@lo:400: 00000100:00100000:3.0:1784403231.969785:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260818432:12345-0@lo:400: Request processed in 24us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403231.969790:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784403231.969806:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260817920 00000100:00100000:3.0:1784403231.969809:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260817920 00000100:00100000:3.0:1784403231.969831:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784403231.969837:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260817920:12345-0@lo:400: 00000100:00100000:3.0:1784403231.969884:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260817920:12345-0@lo:400: Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403231.969899:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1784403231.969929:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403231.969965:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260817920:0@lo:400: 00000100:00100000:3.0:1784403231.969981:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260818432:0@lo:400: 00000100:00100000:3.0:1784403231.970005:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260818048:0@lo:400: 00000100:00100000:3.0:1784403231.970064:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260818560 00000100:00100000:3.0:1784403231.970068:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260818560 00000100:00100000:3.0:1784403231.970104:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784403231.970111:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260818560:12345-0@lo:400: 00000100:00100000:3.0:1784403231.970148:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260818560:12345-0@lo:400: Request processed in 38us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403231.970154:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784403231.970173:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260818304:0@lo:400: 00000100:00100000:3.0:1784403231.970199:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403231.970220:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784403231.970225:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260818176:0@lo:400: 00000100:00100000:3.0:1784403231.970246:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784403231.970270:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403231.970277:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260818176 00000100:00100000:3.0:1784403231.970281:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260818176 00000100:00100000:3.0:1784403231.970304:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784403231.970310:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260818176:12345-0@lo:400: 00000100:00100000:3.0:1784403231.970341:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260818176:12345-0@lo:400: Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403231.970347:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1784403231.970367:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403231.970383:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260818176:0@lo:400: 00010000:00080000:3.0:1784403231.970405:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a81b58000 x1871082260818560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403231.970416:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260818560:0@lo:400: 00000100:00100000:3.0:1784403231.970455:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260818304 00000100:00100000:3.0:1784403231.970458:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260818304 00000100:00080000:2.0:1784403231.970764:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403231.970944:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784403231.970954:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260818304:12345-0@lo:400: 00000100:00100000:3.0:1784403231.971019:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260818304:12345-0@lo:400: Request processed in 67us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403231.971026:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1784403231.975627:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a4302ea00 x1871082260818304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403231.975654:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260818304:0@lo:400: 00000100:00100000:1.0:1784403232.481041:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260818688:0@lo:13: 00000100:00100000:1.0:1784403232.481143:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403232.485541:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260818688 00000100:00100000:2.0:1784403232.485566:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260818688 00000100:00100000:2.0:1784403232.485661:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784403232.485674:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260818688:12345-0@lo:13: 00002000:00000024:2.0:1784403232.485728:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403232.485913:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260818688:12345-0@lo:13: Request processed in 241us (4769us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403232.485923:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1784403232.486484:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a81b58000 x1871082260818688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403232.486512:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260818688:0@lo:13: 00010000:00010000:2.0:1784403232.608711:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403232.831655:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403232.831713:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403232.831760:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240872960 00000100:00100000:2.0:1784403232.831766:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403232.831778:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240872704 00000100:00100000:3.0:1784403232.831784:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240872960 00000100:00100000:1.0:1784403232.831790:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240872704 00000100:00100000:2.0:1784403232.831814:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403232.831911:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:1.0:1784403232.831929:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240872704:12345-192.168.204.28@tcp:400: 00000100:00100000:3.0:1784403232.831999:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240872832 00000100:00100000:3.0:1784403232.832006:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240872832 00000100:00100000:0.0:1784403232.832009:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240872576 00000100:00100000:0.0:1784403232.832017:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240872576 00000100:00100000:1.0:1784403232.832043:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240872704:12345-192.168.204.28@tcp:400: Request processed in 117us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403232.832054:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:3.0:1784403232.832071:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:0.0:1784403232.832072:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:0.0:1784403232.832087:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240872576:12345-192.168.204.28@tcp:400: 00000100:00080000:1.0:1784403232.832088:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784403232.832096:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403232.832099:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240872960:12345-192.168.204.28@tcp:400: 00000100:00080000:1.0:1784403232.832102:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403232.832133:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240872576:12345-192.168.204.28@tcp:400: Request processed in 48us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403232.832142:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:0.0:1784403232.832190:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1784403232.832200:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240872832:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1784403232.832234:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240872832:12345-192.168.204.28@tcp:400: Request processed in 36us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403232.832240:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:3.0:1784403232.835722:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240872960:12345-192.168.204.28@tcp:400: Request processed in 3622us (3997us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403232.835741:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000020:00000080:0.0:1784403232.889065:0:8808:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc1f54190 20000000:00000080:0.0:1784403232.889091:0:8808:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c8a72e33800 uarg=0000000000000000 20000000:01000000:0.0:1784403232.889139:0:8808:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1784403232.889141:0:8808:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1784403232.889145:0:8808:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784403232.889151:0:8808:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784403232.889158:0:8808:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1784403232.889175:0:8808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784403232.889245:0:8808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784403232.889474:0:8808:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784403232.889478:0:8808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784403232.890403:0:8809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1784403232.890999:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1784403232.891076:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1784403232.891107:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1784403232.891117:0:8808:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784403232.891119:0:8808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784403232.891696:0:8810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1784403232.892121:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1784403232.892167:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1784403232.892281:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1784403232.892293:0:8808:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784403232.892295:0:8808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784403232.893146:0:8811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1784403232.893678:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1784403232.893744:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1784403232.893784:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1784403232.893796:0:8808:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784403232.893798:0:8808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784403232.895390:0:8812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1784403232.896046:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1784403232.896103:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1784403232.896154:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1784403232.896172:0:8808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784403232.896267:0:8808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896290:0:8808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce6400/0x6828175665afa5c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa5bd expref: 18 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896298:0:8808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a5b67a200/0x6828175665afa5ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa5e7 expref: 18 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896305:0:8808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a5b67b400/0x6828175665afa618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa611 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896312:0:8808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa61f expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896331:0:8808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a5b67be00/0x6828175665afa634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa62d expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896338:0:8808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa649 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896346:0:8808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a5b67a800/0x6828175665afa67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa673 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896357:0:8808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a5b67b000/0x6828175665afa688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e999 expref: 9 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896364:0:8808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a5b67b800/0x6828175665afa68f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9a0 expref: 9 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896375:0:8808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896426:0:8808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a5b67b800/0x6828175665afa68f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9a0 expref: 9 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896445:0:8808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a5b67b800/0x6828175665afa68f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9a0 expref: 9 pid: 6286 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.896464:0:8808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260818816:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403232.896653:0:8808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a5b67b000/0x6828175665afa688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e999 expref: 9 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896661:0:8808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a5b67b000/0x6828175665afa688 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e999 expref: 9 pid: 6286 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.896679:0:8808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260818944:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403232.896730:0:8808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a5b67a800/0x6828175665afa67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa673 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896739:0:8808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a5b67a800/0x6828175665afa67a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa673 expref: 18 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.896750:0:8808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819072:0@lo:104: 00000100:00100000:0.0:1784403232.896802:0:8808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784403232.896935:0:8808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa649 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.896944:0:8808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa650 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa649 expref: 18 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.896953:0:8808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819200:0@lo:104: 00000100:00100000:0.0:1784403232.896976:0:8808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784403232.898546:0:8808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a5b67be00/0x6828175665afa634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa62d expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.898564:0:8808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a5b67be00/0x6828175665afa634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa62d expref: 18 pid: 6287 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.898578:0:8808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819328:0@lo:104: 00010000:00010000:0.0:1784403232.898642:0:8808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa61f expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.898650:0:8808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa626 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa61f expref: 18 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.898679:0:8808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819456:0@lo:104: 00010000:00010000:0.0:1784403232.898706:0:8808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a5b67b400/0x6828175665afa618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa611 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.898714:0:8808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a5b67b400/0x6828175665afa618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa611 expref: 18 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.898721:0:8808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819584:0@lo:104: 00010000:00010000:0.0:1784403232.898745:0:8808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a5b67a200/0x6828175665afa5ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa5e7 expref: 18 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.898753:0:8808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a5b67a200/0x6828175665afa5ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa5e7 expref: 18 pid: 6285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.898761:0:8808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819712:0@lo:104: 00010000:00010000:0.0:1784403232.898779:0:8808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce6400/0x6828175665afa5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa5bd expref: 18 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.898787:0:8808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a7fce6400/0x6828175665afa5c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa5bd expref: 18 pid: 6285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.898794:0:8808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819840:0@lo:104: 00000100:00100000:0.0:1784403232.898807:0:8808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cf73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784403232.898858:0:6275:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784403232.899039:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403232.899059:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403232.899068:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403232.899075:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403232.899083:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403232.899091:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260819072 00000100:00100000:3.0:1784403232.899099:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260819072 00000100:00100000:3.0:1784403232.899149:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260819200 00000100:00100000:3.0:1784403232.899151:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260819200 00000100:00100000:3.0:1784403232.899159:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260819328 00000100:00100000:3.0:1784403232.899161:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260819328 00000100:00100000:3.0:1784403232.899169:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260819456 00000100:00100000:3.0:1784403232.899170:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260819456 00000100:00100000:3.0:1784403232.899248:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260819584 00000100:00100000:3.0:1784403232.899251:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260819584 00000100:00100000:3.0:1784403232.899261:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260819712 00000100:00100000:3.0:1784403232.899263:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260819712 00000100:00100000:3.0:1784403232.899270:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260819840 00000100:00100000:3.0:1784403232.899271:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260819840 00000100:00100000:3.0:1784403232.899283:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784403232.899292:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+9:8808:x1871082260819072:12345-0@lo:104: 00010000:00010000:3.0:1784403232.899307:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899411:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784403232.899418:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+9:8808:x1871082260819072:12345-0@lo:104: Request processed in 127us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403232.899424:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784403232.899445:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784403232.899450:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ff59850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+8:8808:x1871082260819200:12345-0@lo:104: 00010000:00010000:3.0:1784403232.899457:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899505:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784403232.899510:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ff59850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+8:8808:x1871082260819200:12345-0@lo:104: Request processed in 60us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403232.899515:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784403232.899547:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784403232.899552:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+7:8808:x1871082260819328:12345-0@lo:104: 00010000:00010000:3.0:1784403232.899559:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899580:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784403232.899585:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+7:8808:x1871082260819328:12345-0@lo:104: Request processed in 33us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403232.899590:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784403232.899612:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784403232.899618:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+6:8808:x1871082260819456:12345-0@lo:104: 00010000:00010000:3.0:1784403232.899625:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899646:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784403232.899650:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+6:8808:x1871082260819456:12345-0@lo:104: Request processed in 33us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403232.899656:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784403232.899665:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784403232.899670:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+5:8808:x1871082260819584:12345-0@lo:104: 00010000:00010000:3.0:1784403232.899677:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899708:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1784403232.899712:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+5:8808:x1871082260819584:12345-0@lo:104: Request processed in 43us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403232.899718:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784403232.899729:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784403232.899734:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+4:8808:x1871082260819712:12345-0@lo:104: 00010000:00010000:3.0:1784403232.899740:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899760:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1784403232.899765:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+4:8808:x1871082260819712:12345-0@lo:104: Request processed in 31us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403232.899770:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784403232.899778:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784403232.899782:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:8808:x1871082260819840:12345-0@lo:104: 00010000:00010000:3.0:1784403232.899788:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899806:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1784403232.899810:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:8808:x1871082260819840:12345-0@lo:104: Request processed in 28us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403232.899816:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1784403232.899835:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784403232.899842:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899850:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a5b67a000 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403232.899861:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899900:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403232.899909:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403232.899916:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784403232.899955:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899961:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403232.899983:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.899990:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67a000/0x6828175665afa673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa67a expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900004:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784403232.900007:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900012:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7a00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403232.900015:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900022:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403232.900038:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403232.900043:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784403232.900055:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900059:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403232.900073:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900080:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa650 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900088:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784403232.900091:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900096:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a5b67aa00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403232.900099:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900106:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403232.900112:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403232.900116:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784403232.900131:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900137:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403232.900142:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900148:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67aa00/0x6828175665afa62d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa634 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900155:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784403232.900158:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900163:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a5b67ac00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403232.900165:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900171:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.900279:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:3.0:1784403232.900322:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403232.900329:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784403232.900343:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900349:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403232.900354:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900370:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ac00/0x6828175665afa61f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa626 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900379:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784403232.900382:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900387:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6000 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403232.900390:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900397:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403232.900403:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403232.900408:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784403232.900418:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900423:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403232.900426:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900432:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6000/0x6828175665afa5e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa5ee expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900439:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403232.900446:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900452:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a5b67b200 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403232.900455:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900461:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403232.900466:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403232.900471:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784403232.900481:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900485:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403232.900489:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900494:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67b200/0x6828175665afa5bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa5c4 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.900503:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403232.900505:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403232.900507:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403232.900523:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260819968:0@lo:103: 00000100:00100000:3.0:1784403232.900587:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403232.900652:0:6274:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1784403232.900679:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260820480:0@lo:103: 00000100:00100000:3.0:1784403232.900710:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403232.900798:0:8808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819072:0@lo:104: 00000100:00100000:0.0:1784403232.900811:0:8808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819200:0@lo:104: 00000100:00100000:0.0:1784403232.900818:0:8808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819328:0@lo:104: 00000100:00100000:0.0:1784403232.900826:0:8808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819456:0@lo:104: 00000100:00100000:0.0:1784403232.900844:0:8808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819584:0@lo:104: 00000100:00100000:0.0:1784403232.900851:0:8808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819712:0@lo:104: 00000100:00100000:0.0:1784403232.900858:0:8808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260819840:0@lo:104: 00000100:00100000:3.0:1784403232.905264:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784403232.905294:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260820352:0@lo:103: 00000100:00100000:3.0:1784403232.905380:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403232.905517:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260819968 00000100:00100000:2.0:1784403232.905529:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260819968 00010000:00010000:2.0:1784403232.905578:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a5b67a800/0x6828175665afa67a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa673 expref: 19 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403232.905673:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260820480 00000100:00100000:2.0:1784403232.905677:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260820480 00010000:00010000:2.0:1784403232.905692:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a5b67a200/0x6828175665afa5ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa5e7 expref: 20 pid: 6285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403232.905808:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260820096:0@lo:103: 00000100:00100000:3.0:1784403232.905838:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403232.905850:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260820608:0@lo:103: 00000100:00100000:3.0:1784403232.905895:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403232.905909:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784403232.905915:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260820224:0@lo:103: 00000100:00100000:3.0:1784403232.905936:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403232.906032:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403232.906052:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403232.906370:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260820352 00000100:00100000:0.0:1784403232.906377:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260820352 00010000:00010000:0.0:1784403232.906400:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa626 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa61f expref: 21 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.906419:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260820096 00000100:00100000:0.0:1784403232.906423:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260820096 00010000:00010000:0.0:1784403232.906437:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa650 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa649 expref: 22 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.906447:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260820608 00000100:00100000:0.0:1784403232.906450:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260820608 00010000:00010000:0.0:1784403232.906460:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce6400/0x6828175665afa5c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa5bd expref: 23 pid: 6285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.906470:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260820224 00000100:00100000:0.0:1784403232.906472:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260820224 00010000:00010000:0.0:1784403232.906483:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a5b67be00/0x6828175665afa634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa62d expref: 24 pid: 6287 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.906492:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240873088 00000100:00100000:0.0:1784403232.906495:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240873088 00010000:00010000:0.0:1784403232.906508:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a5b67b800/0x6828175665afa68f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9a0 expref: 10 pid: 6286 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.906517:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240873216 00000100:00100000:0.0:1784403232.906519:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240873216 00010000:00010000:0.0:1784403232.906530:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a5b67b000/0x6828175665afa688 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e999 expref: 11 pid: 6286 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.906557:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784403232.906567:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+24:3566:x1871082260819968:12345-0@lo:103: 00010000:00010000:0.0:1784403232.906586:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403232.906604:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a5b67a800/0x6828175665afa67a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa673 expref: 24 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.906617:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a5b67a800/0x6828175665afa67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa673 expref: 24 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.906640:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67a800/0x6828175665afa67a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa673 expref: 24 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.906663:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403232.906769:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+23:3566:x1871082260819968:12345-0@lo:103: Request processed in 203us (6181us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403232.906777:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784403232.906798:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784403232.906805:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+22:3566:x1871082260820480:12345-0@lo:103: 00010000:00010000:0.0:1784403232.906815:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403232.906820:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a5b67a200/0x6828175665afa5ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa5e7 expref: 22 pid: 6285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.906829:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a5b67a200/0x6828175665afa5ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa5e7 expref: 22 pid: 6285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.906840:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67a200/0x6828175665afa5ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa5e7 expref: 22 pid: 6285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.906861:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403232.906907:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+21:3566:x1871082260820480:12345-0@lo:103: Request processed in 102us (6196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403232.906915:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784403232.906929:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784403232.906936:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+20:3566:x1871082260820352:12345-0@lo:103: 00010000:00010000:0.0:1784403232.906945:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403232.906949:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa626 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa61f expref: 20 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.906959:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa61f expref: 20 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.906969:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67a400/0x6828175665afa626 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa61f expref: 20 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.906979:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403232.907002:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260820352:12345-0@lo:103: Request processed in 67us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403232.907008:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784403232.907022:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784403232.907029:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+18:3567:x1871082260820096:12345-0@lo:103: 00010000:00010000:0.0:1784403232.907037:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403232.907041:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa650 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa649 expref: 18 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907050:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa649 expref: 18 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907068:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa649 expref: 18 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907077:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403232.907108:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+17:3567:x1871082260820096:12345-0@lo:103: Request processed in 80us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403232.907115:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784403232.907129:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784403232.907135:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+16:3567:x1871082260820608:12345-0@lo:103: 00010000:00010000:0.0:1784403232.907142:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403232.907147:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce6400/0x6828175665afa5c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa5bd expref: 16 pid: 6285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907154:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce6400/0x6828175665afa5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa5bd expref: 16 pid: 6285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907165:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6400/0x6828175665afa5c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa5bd expref: 16 pid: 6285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907173:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403232.907277:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+15:3567:x1871082260820608:12345-0@lo:103: Request processed in 142us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403232.907284:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784403232.907299:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784403232.907305:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+14:3567:x1871082260820224:12345-0@lo:103: 00010000:00010000:0.0:1784403232.907313:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403232.907317:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a5b67be00/0x6828175665afa634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa62d expref: 14 pid: 6287 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907332:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a5b67be00/0x6828175665afa634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa62d expref: 14 pid: 6287 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907344:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67be00/0x6828175665afa634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa62d expref: 14 pid: 6287 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907357:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403232.907382:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+13:3567:x1871082260820224:12345-0@lo:103: Request processed in 78us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403232.907389:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784403232.907404:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:0.0:1784403232.907411:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42d02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:2361:x1871082240873088:12345-192.168.204.28@tcp:103: 00010000:00010000:0.0:1784403232.907420:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403232.907425:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a5b67b800/0x6828175665afa68f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9a0 expref: 11 pid: 6286 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907436:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a5b67b800/0x6828175665afa68f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9a0 expref: 11 pid: 6286 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907446:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403232.907493:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42d02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:2361:x1871082240873088:12345-192.168.204.28@tcp:103: Request processed in 82us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403232.907500:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:0.0:1784403232.907537:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:0.0:1784403232.907542:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2361:x1871082240873216:12345-192.168.204.28@tcp:103: 00010000:00010000:0.0:1784403232.907549:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403232.907558:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a5b67b000/0x6828175665afa688 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e999 expref: 10 pid: 6286 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907568:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a5b67b000/0x6828175665afa688 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e999 expref: 10 pid: 6286 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.907578:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403232.907608:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2361:x1871082240873216:12345-192.168.204.28@tcp:103: Request processed in 65us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403232.907614:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00010000:00010000:0.0:1784403232.907806:0:8808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67b800/0x6828175665afa68f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9a0 expref: 9 pid: 6286 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.907817:0:8808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260818816:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403232.907829:0:8808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67b000/0x6828175665afa688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e999 expref: 8 pid: 6286 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403232.907837:0:8808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8808:1871082260818944:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403232.907913:0:8808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403232.908131:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403232.908134:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403232.908136:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403232.908321:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260819968:0@lo:103: 00000100:00100000:3.0:1784403232.908333:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260820480:0@lo:103: 00000100:00100000:3.0:1784403232.908352:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260820352:0@lo:103: 00000100:00100000:3.0:1784403232.908375:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260820224:0@lo:103: 00000100:00100000:3.0:1784403232.908383:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260820096:0@lo:103: 00000100:00100000:3.0:1784403232.908390:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260820608:0@lo:103: 00010000:00010000:2.0:1784403232.908429:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.908440:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a41670400 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:2.0:1784403232.908445:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.908456:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784403232.908473:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403232.908480:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784403232.908561:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.908569:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784403232.908606:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.908615:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a41670400/0x6828175665afa611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa618 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.908633:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403232.908635:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403232.908637:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403232.909131:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260820736:0@lo:103: 00000100:00100000:3.0:1784403232.909270:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403232.909381:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260820736 00000100:00100000:2.0:1784403232.909390:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260820736 00010000:00010000:2.0:1784403232.909424:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a5b67b400/0x6828175665afa618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa611 expref: 13 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403232.909462:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784403232.909472:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+13:3568:x1871082260820736:12345-0@lo:103: 00010000:00010000:2.0:1784403232.909487:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403232.909492:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a5b67b400/0x6828175665afa618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa611 expref: 13 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909504:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a5b67b400/0x6828175665afa618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa611 expref: 13 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909534:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67b400/0x6828175665afa618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa611 expref: 13 pid: 6286 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909556:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909567:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909585:0:6276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909605:0:6276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909613:0:6276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909620:0:6276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909627:0:6276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40030e00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:2.0:1784403232.909631:0:6276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909640:0:6276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909658:0:6276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403232.909682:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403232.909722:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+12:3568:x1871082260820736:12345-0@lo:103: Request processed in 250us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403232.909729:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784403232.909807:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260820736:0@lo:103: 00010000:00010000:3.0:1784403232.909943:0:8808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.909953:0:8808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403232.909960:0:8808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a40030e00/0x6828175665afa6c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403233.631177:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784403234.401302:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784403234.401318:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a42cc6000 from 39 10000000:01000000:0.0:1784403234.401326:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784403234.401414:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.401461:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.401479:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403234.401512:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260820864:0@lo:101: 00000100:00100000:0.0:1784403234.401641:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403234.401738:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cf73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.402266:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260820864 00000100:00100000:3.0:1784403234.402277:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260820864 00000100:00100000:3.0:1784403234.402350:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784403234.402362:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+12:6290:x1871082260820864:12345-0@lo:101: 00010000:00010000:3.0:1784403234.402379:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403234.402399:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6000/0x6828175665afa6d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa6ce expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403234.402430:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6000/0x6828175665afa6d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa6ce expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403234.402441:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6000/0x6828175665afa6d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa6ce expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403234.402451:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6000, rc 0) 00000100:00100000:3.0:1784403234.402520:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260820864:12345-0@lo:101: Request processed in 161us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403234.402528:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784403234.402712:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260820864:0@lo:101: 00010000:00010000:1.0:1784403234.402734:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403234.402744:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403234.402819:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260820992:0@lo:501: 00000100:00100000:1.0:1784403234.402852:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403234.402923:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca6480 going to sleep for 11 seconds 00000100:00100000:0.0:1784403234.402975:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260820992 00000100:00100000:0.0:1784403234.402980:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260820992 00000100:00100000:0.0:1784403234.403438:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784403234.403448:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260820992:12345-0@lo:501: 00000100:00100000:0.0:1784403234.403823:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260820992:12345-0@lo:501: Request processed in 375us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403234.403830:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784403234.404200:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260820992:0@lo:501: 00000100:00100000:1.0:1784403234.404247:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260821120:0@lo:503: 00000100:00100000:1.0:1784403234.404297:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403234.404331:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca6480 going to sleep for 11 seconds 00000100:00100000:0.0:1784403234.405138:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260821120 00000100:00100000:0.0:1784403234.405147:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260821120 00000100:00100000:0.0:1784403234.405195:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784403234.405203:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260821120:12345-0@lo:503: 00000100:00100000:0.0:1784403234.405407:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260821120:12345-0@lo:503: Request processed in 204us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403234.405414:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784403234.405552:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260821120:0@lo:503: 00000100:00100000:1.0:1784403234.405962:0:8825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8825:1871082260821248:0@lo:502: 00000100:00100000:1.0:1784403234.406023:0:8825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403234.406060:0:8825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.406155:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260821248 00000100:00100000:3.0:1784403234.406161:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260821248 00000100:00100000:3.0:1784403234.406204:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784403234.406212:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:8825:x1871082260821248:12345-0@lo:502: 00000100:00100000:3.0:1784403234.406415:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+13:8825:x1871082260821248:12345-0@lo:502: Request processed in 203us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403234.406422:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784403234.406967:0:8825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8825:1871082260821248:0@lo:502: 00000100:00100000:1.0:1784403234.407034:0:8825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8825:1871082260821376:0@lo:502: 00000100:00100000:1.0:1784403234.407074:0:8825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403234.407105:0:8825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.407205:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260821376 00000100:00100000:3.0:1784403234.407209:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260821376 00000100:00100000:3.0:1784403234.407250:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784403234.407258:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:8825:x1871082260821376:12345-0@lo:502: 00000100:00100000:3.0:1784403234.407434:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+13:8825:x1871082260821376:12345-0@lo:502: Request processed in 176us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403234.407441:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784403234.407558:0:8825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8825:1871082260821376:0@lo:502: 00000040:00080000:1.0:1784403234.407588:0:8825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784403234.407803:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1784403234.407822:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784403234.407835:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.407854:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403234.407904:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1784403234.407907:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1784403234.407911:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784403234.407943:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.407952:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.407964:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403234.407981:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260821504:0@lo:101: 00000100:00100000:0.0:1784403234.408026:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403234.408066:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cf739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403234.408132:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260821504 00000100:00100000:2.0:1784403234.408138:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260821504 00000100:00100000:2.0:1784403234.408174:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784403234.408182:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+13:6290:x1871082260821504:12345-0@lo:101: 00010000:00010000:2.0:1784403234.408192:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403234.408206:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b2c00/0x6828175665afa6e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa6dc expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.408231:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b2c00/0x6828175665afa6e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa6dc expref: 14 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.408243:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b2c00/0x6828175665afa6e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa6dc expref: 14 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.408252:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2c00, rc 0) 00000100:00100000:2.0:1784403234.408293:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260821504:12345-0@lo:101: Request processed in 112us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403234.408299:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784403234.408461:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260821504:0@lo:101: 00010000:00010000:0.0:1784403234.408477:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.408487:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403234.408535:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260821632:0@lo:501: 00000100:00100000:0.0:1784403234.408559:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403234.408604:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cf739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.408654:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260821632 00000100:00100000:3.0:1784403234.408659:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260821632 00000100:00100000:3.0:1784403234.408688:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784403234.408696:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260821632:12345-0@lo:501: 00000100:00100000:3.0:1784403234.409060:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260821632:12345-0@lo:501: Request processed in 364us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403234.409067:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784403234.409228:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260821632:0@lo:501: 00000100:00100000:0.0:1784403234.409260:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260821760:0@lo:503: 00000100:00100000:0.0:1784403234.409306:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403234.409338:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cf739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.409457:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260821760 00000100:00100000:3.0:1784403234.409462:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260821760 00000100:00100000:3.0:1784403234.409494:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784403234.409501:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260821760:12345-0@lo:503: 00000100:00100000:3.0:1784403234.409692:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260821760:12345-0@lo:503: Request processed in 190us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403234.409699:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784403234.409785:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260821760:0@lo:503: 00000100:00100000:1.0:1784403234.416933:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8826:1871082260821888:0@lo:502: 00000100:00100000:1.0:1784403234.417089:0:8826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403234.417155:0:8826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403234.417296:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260821888 00000100:00100000:2.0:1784403234.417308:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260821888 00000100:00100000:2.0:1784403234.417374:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784403234.417385:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:8826:x1871082260821888:12345-0@lo:502: 00000100:00100000:2.0:1784403234.417684:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+14:8826:x1871082260821888:12345-0@lo:502: Request processed in 299us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403234.417692:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784403234.418008:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8826:1871082260821888:0@lo:502: 00000020:01000000:1.0:1784403234.418048:0:8826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403234.418060:0:8826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403234.418063:0:8826:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784403234.418072:0:8826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784403234.418105:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8826:1871082260822016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403234.418143:0:8826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403234.418176:0:8826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45ce8300 going to sleep for 11 seconds 00000100:00100000:2.0:1784403234.418266:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260822016 00000100:00100000:2.0:1784403234.418271:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260822016 00000100:00100000:2.0:1784403234.418307:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784403234.418313:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:8826:x1871082260822016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403234.418458:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:8826:x1871082260822016:12345-0@lo:502:llog_process_th.0 Request processed in 145us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403234.418465:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784403234.422462:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8826:1871082260822016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784403234.422541:0:8826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403234.422557:0:8826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403234.422560:0:8826:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784403234.422580:0:8826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1784403234.423231:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1784403234.423259:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784403234.423273:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.423287:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403234.423299:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784403234.423302:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a43036800 from 39 10000000:01000000:2.0:1784403234.423305:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784403234.423354:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.423362:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.423373:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403234.423423:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260822144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.423505:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403234.423560:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a522713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403234.423630:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260822144 00000100:00100000:1.0:1784403234.423638:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260822144 00000100:00100000:1.0:1784403234.423701:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784403234.423711:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+14:6290:x1871082260822144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403234.423730:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403234.423745:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a41670e00/0x6828175665afa6f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa6ea expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403234.423776:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41670e00/0x6828175665afa6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa6ea expref: 15 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403234.423788:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a41670e00/0x6828175665afa6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa6ea expref: 15 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403234.423811:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a41670e00, rc 0) 00000100:00100000:1.0:1784403234.423862:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260822144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403234.423904:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784403234.424114:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260822144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403234.424131:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.424142:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403234.424199:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260822272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.424225:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403234.424252:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a522713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.424304:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260822272 00000100:00100000:3.0:1784403234.424316:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260822272 00000100:00100000:3.0:1784403234.424350:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784403234.424358:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260822272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403234.424711:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260822272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403234.424719:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784403234.425323:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260822272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.425372:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260822400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.425431:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403234.425466:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a522713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403234.425522:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260822400 00000100:00100000:0.0:1784403234.425528:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260822400 00000100:00100000:0.0:1784403234.425578:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784403234.425588:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260822400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403234.425794:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260822400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403234.425802:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784403234.426171:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260822400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403234.426698:0:8827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8827:1871082260822528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403234.426761:0:8827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403234.426800:0:8827:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cf73b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784403234.426853:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260822528 00000100:00100000:1.0:1784403234.426859:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260822528 00000100:00100000:1.0:1784403234.426940:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784403234.426951:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+15:8827:x1871082260822528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403234.427281:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+15:8827:x1871082260822528:12345-0@lo:502:llog_process_th.0 Request processed in 332us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403234.427289:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784403234.427513:0:8827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8827:1871082260822528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403234.427578:0:8827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8827:1871082260822656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403234.427620:0:8827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403234.427658:0:8827:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45718300 going to sleep for 11 seconds 00000100:00100000:0.0:1784403234.427716:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260822656 00000100:00100000:0.0:1784403234.427721:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260822656 00000100:00100000:0.0:1784403234.427755:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784403234.427763:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+15:8827:x1871082260822656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403234.427969:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+15:8827:x1871082260822656:12345-0@lo:502:llog_process_th.0 Request processed in 205us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403234.427976:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784403234.428214:0:8827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8827:1871082260822656:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784403234.428236:0:8827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784403234.428437:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1784403234.428458:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784403234.428472:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.428485:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403234.428503:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784403234.428506:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1784403234.428509:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784403234.428541:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.428550:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.428560:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403234.428588:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260822784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.428625:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403234.428659:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a522713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403234.428775:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260822784 00000100:00100000:1.0:1784403234.428781:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260822784 00000100:00100000:1.0:1784403234.428813:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784403234.428822:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+15:6290:x1871082260822784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403234.428834:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403234.428850:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a41670600/0x6828175665afa6ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa6f8 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403234.428908:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41670600/0x6828175665afa6ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa6f8 expref: 16 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403234.428920:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a41670600/0x6828175665afa6ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa6f8 expref: 16 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403234.428931:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a41670600, rc 0) 00000100:00100000:1.0:1784403234.428974:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260822784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403234.428980:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784403234.429326:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260822784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403234.429344:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.429355:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403234.429408:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260822912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.429437:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403234.429501:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a522713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.433466:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260822912 00000100:00100000:3.0:1784403234.433488:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260822912 00000100:00100000:3.0:1784403234.433608:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784403234.433623:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260822912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403234.434281:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260822912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 657us (4838us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403234.434292:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784403234.438718:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260822912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.438810:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260823040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.439133:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403234.439182:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a522713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403234.439242:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260823040 00000100:00100000:0.0:1784403234.439251:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260823040 00000100:00100000:0.0:1784403234.439313:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784403234.439323:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260823040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403234.439561:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260823040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403234.439578:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784403234.439705:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260823040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403234.441444:0:8828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8828:1871082260823168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403234.441547:0:8828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403234.441612:0:8828:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43e28cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403234.441715:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260823168 00000100:00100000:2.0:1784403234.441725:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260823168 00000100:00100000:2.0:1784403234.441788:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784403234.441799:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:8828:x1871082260823168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403234.442132:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:8828:x1871082260823168:12345-0@lo:502:llog_process_th.0 Request processed in 333us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403234.442141:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784403234.442311:0:8828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8828:1871082260823168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784403234.442346:0:8828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784403234.442357:0:8828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403234.442360:0:8828:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784403234.442365:0:8828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784403234.442391:0:8828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8828:1871082260823296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403234.442424:0:8828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403234.442447:0:8828:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a44d29840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.442488:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260823296 00000100:00100000:3.0:1784403234.442493:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260823296 00000100:00100000:3.0:1784403234.442518:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784403234.442525:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:8828:x1871082260823296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403234.442677:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:8828:x1871082260823296:12345-0@lo:502:llog_process_th.0 Request processed in 152us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403234.442694:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784403234.442759:0:8828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8828:1871082260823296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784403234.442778:0:8828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403234.442782:0:8828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403234.442783:0:8828:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784403234.442787:0:8828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1784403234.443002:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1784403234.443024:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784403234.443036:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403234.443047:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403234.443056:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784403234.443059:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a5270b000 from 39 10000000:01000000:3.0:1784403234.443062:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784403234.443092:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403234.443099:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403234.443109:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403234.443121:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260823424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784403234.443150:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403234.443177:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45718c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403234.443236:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260823424 00000100:00100000:2.0:1784403234.443241:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260823424 00000100:00100000:2.0:1784403234.443272:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784403234.443282:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260823424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403234.443292:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403234.443307:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afa70d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa706 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.443334:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afa70d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa706 expref: 17 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.443347:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afa70d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa706 expref: 17 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.443356:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3600, rc 0) 00000100:00100000:2.0:1784403234.443386:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260823424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403234.443401:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784403234.443660:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260823424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403234.443676:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403234.443697:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403234.443747:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260823552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403234.443772:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403234.443803:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45718c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784403234.443848:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260823552 00000100:00100000:0.0:1784403234.443852:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260823552 00000100:00100000:0.0:1784403234.443923:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784403234.443930:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260823552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403234.444238:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260823552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403234.444245:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784403234.444433:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260823552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403234.444468:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260823680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403234.444508:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403234.444530:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45718c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403234.444603:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260823680 00000100:00100000:2.0:1784403234.444608:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260823680 00000100:00100000:2.0:1784403234.444640:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784403234.444648:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260823680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.444817:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260823680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403234.444823:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784403234.445019:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260823680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403234.448228:0:8829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8829:1871082260823808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403234.448349:0:8829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403234.448404:0:8829:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45718240 going to sleep for 11 seconds 00000100:00100000:2.0:1784403234.448461:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260823808 00000100:00100000:2.0:1784403234.448470:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260823808 00000100:00100000:2.0:1784403234.448525:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784403234.448538:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:8829:x1871082260823808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403234.450717:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:8829:x1871082260823808:12345-0@lo:502:llog_process_th.0 Request processed in 2166us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403234.450735:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784403234.460698:0:8829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8829:1871082260823808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403234.460827:0:8829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8829:1871082260823936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403234.460949:0:8829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403234.461017:0:8829:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a44d29300 going to sleep for 11 seconds 00000100:00100000:1.0:1784403234.461020:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260823936 00000100:00100000:1.0:1784403234.461028:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260823936 00000100:00100000:1.0:1784403234.461092:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784403234.461103:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:8829:x1871082260823936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403234.461419:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:8829:x1871082260823936:12345-0@lo:502:llog_process_th.0 Request processed in 316us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403234.461427:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784403234.461529:0:8829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8829:1871082260823936:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784403234.461553:0:8829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784403234.461772:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1784403234.461794:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784403234.461806:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.461819:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403234.461828:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784403234.461831:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1784403234.461835:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784403234.461901:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.461919:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.461929:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403234.461947:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260824064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.461995:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403234.462025:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a52271f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784403234.462216:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260824064 00000100:00100000:0.0:1784403234.462222:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260824064 00000100:00100000:0.0:1784403234.462254:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784403234.462261:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260824064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403234.462274:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403234.462289:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a40030600/0x6828175665afa71b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa714 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.462317:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a40030600/0x6828175665afa71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa714 expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.462330:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a40030600/0x6828175665afa71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa714 expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.462340:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40030600, rc 0) 00000100:00100000:0.0:1784403234.462391:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260824064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403234.462397:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784403234.462410:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260824064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403234.462427:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403234.462437:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403234.462493:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260824192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403234.462534:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403234.462557:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4315f540 going to sleep for 11 seconds 00000100:00100000:0.0:1784403234.462633:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260824192 00000100:00100000:0.0:1784403234.462638:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260824192 00000100:00100000:0.0:1784403234.462666:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784403234.462673:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260824192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403234.463043:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260824192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403234.463050:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784403234.463123:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260824192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403234.463162:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260824320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784403234.463203:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403234.463236:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4315f540 going to sleep for 11 seconds 00000100:00100000:2.0:1784403234.463338:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260824320 00000100:00100000:2.0:1784403234.463343:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260824320 00000100:00100000:2.0:1784403234.463376:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784403234.463385:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260824320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.463557:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260824320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403234.463563:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784403234.463607:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260824320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784403234.464147:0:8830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8830:1871082260824448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403234.464186:0:8830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403234.464214:0:8830:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc250c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403234.464255:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260824448 00000100:00100000:2.0:1784403234.464259:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260824448 00000100:00100000:2.0:1784403234.464285:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784403234.464292:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:8830:x1871082260824448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403234.464480:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:8830:x1871082260824448:12345-0@lo:502:llog_process_th.0 Request processed in 188us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403234.464487:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784403234.464577:0:8830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8830:1871082260824448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784403234.464607:0:8830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403234.464620:0:8830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403234.464623:0:8830:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784403234.464633:0:8830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784403234.464656:0:8830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8830:1871082260824576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403234.464683:0:8830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403234.464698:0:8830:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc250c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.464761:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260824576 00000100:00100000:3.0:1784403234.464766:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260824576 00000100:00100000:3.0:1784403234.464795:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784403234.464802:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:8830:x1871082260824576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403234.464954:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:8830:x1871082260824576:12345-0@lo:502:llog_process_th.0 Request processed in 153us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403234.464961:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784403234.465410:0:8830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8830:1871082260824576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784403234.465432:0:8830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403234.465438:0:8830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403234.465440:0:8830:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784403234.465444:0:8830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1784403234.465705:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1784403234.465726:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784403234.465738:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.465751:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403234.465767:0:6290:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784403234.465770:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c8a526f8000 from 1 10000000:01000000:0.0:1784403234.465773:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784403234.465804:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40030e00/0x6828175665afa722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.465812:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a40030e00/0x6828175665afa722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.465822:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a40030e00/0x6828175665afa722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403234.465839:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260824704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784403234.465912:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403234.465943:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a44d29c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.466005:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260824704 00000100:00100000:3.0:1784403234.466011:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260824704 00000100:00100000:3.0:1784403234.466040:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784403234.466057:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260824704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403234.466070:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403234.466082:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6e00/0x6828175665afa729 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa722 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403234.466108:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6e00/0x6828175665afa729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa722 expref: 19 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403234.466119:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6e00/0x6828175665afa729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa722 expref: 19 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403234.466128:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6e00, rc 0) 00000100:00100000:3.0:1784403234.466167:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260824704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403234.466174:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784403234.466241:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260824704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403234.466256:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a40030e00/0x6828175665afa722 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa729 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.466271:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a40030e00/0x6828175665afa722 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa729 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403234.466319:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a58093b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260824832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403234.466343:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403234.466369:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a52271d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784403234.466407:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260824832 00000100:00100000:3.0:1784403234.466411:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260824832 00000100:00100000:3.0:1784403234.466435:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784403234.466440:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260824832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403234.466693:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260824832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (348us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784403234.466700:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784403234.466763:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a58093b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260824832:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784403234.466785:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784403234.466791:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40030e00/0x6828175665afa722 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa729 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403234.466800:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a40030e00/0x6828175665afa722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa729 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403234.667576:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403235.039199:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784403235.044551:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260824960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784403235.044686:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403235.045361:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260824960 00000100:00100000:2.0:1784403235.045375:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260824960 00000100:00100000:2.0:1784403235.045486:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784403235.045501:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260824960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403235.045551:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403235.045643:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260824960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403235.045651:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1784403235.046401:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77499f80 x1871082260824960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403235.046428:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260824960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784403235.046975:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784403235.679265:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403236.708216:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403237.087600:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260825216:0@lo:400:kworker.0 00000100:00100000:2.0:1784403237.087717:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403237.087789:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260825728:0@lo:400:kworker.0 00000100:00100000:2.0:1784403237.087815:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403237.087852:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403237.087857:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260825344:0@lo:400:kworker.0 00000100:00100000:2.0:1784403237.087901:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403237.087931:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260825728 00000100:00100000:2.0:1784403237.087940:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260825728 00000100:00100000:2.0:1784403237.088018:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784403237.088029:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260825728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403237.088083:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260825728:12345-0@lo:400:kworker.0 Request processed in 57us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403237.088090:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1784403237.088148:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbf100 x1871082260825728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403237.088163:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260825728:0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.088812:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260825088:0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.088904:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403237.088937:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260825600:0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.088963:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403237.088987:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784403237.088994:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260825472:0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.089016:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403237.089049:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260825088 00000100:00100000:3.0:1784403237.089055:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260825088 00000100:00100000:3.0:1784403237.089093:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784403237.089101:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260825088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.089143:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260825088:12345-0@lo:400:kworker.0 Request processed in 43us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403237.089151:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784403237.089187:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260825216 00000100:00100000:3.0:1784403237.089191:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260825216 00000100:00100000:3.0:1784403237.089211:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260825344 00000100:00100000:3.0:1784403237.089213:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260825344 00000100:00100000:3.0:1784403237.089228:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260825600 00000100:00100000:3.0:1784403237.089230:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260825600 00000100:00100000:3.0:1784403237.089245:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784403237.089251:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260825216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.089290:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260825216:12345-0@lo:400:kworker.0 Request processed in 39us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403237.089296:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784403237.089307:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784403237.089313:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260825344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.089338:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260825344:12345-0@lo:400:kworker.0 Request processed in 26us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403237.089351:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784403237.089363:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784403237.089369:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260825600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.089398:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260825600:12345-0@lo:400:kworker.0 Request processed in 29us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403237.089403:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784403237.089433:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260825088:0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.089445:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260825600:0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.089479:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260825344:0@lo:400:kworker.0 00000100:00100000:3.0:1784403237.089490:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260825216:0@lo:400:kworker.0 00000100:00080000:1.0:1784403237.090436:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784403237.090707:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784403237.092687:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260825472 00000100:00100000:2.0:1784403237.092709:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260825472 00000100:00100000:2.0:1784403237.092821:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784403237.092834:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260825472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403237.093006:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260825472:12345-0@lo:400:kworker.0 Request processed in 174us (3987us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403237.093014:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1784403237.093265:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784403237.094977:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbc000 x1871082260825472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403237.095003:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260825472:0@lo:400:kworker.0 00000100:00100000:2.0:1784403237.599436:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403237.599466:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260825856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784403237.599566:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403237.600628:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260825856 00000100:00100000:3.0:1784403237.600641:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260825856 00000100:00100000:3.0:1784403237.600715:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784403237.600727:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260825856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403237.600776:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403237.600958:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260825856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 232us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403237.600967:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1784403237.603862:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7751c000 x1871082260825856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403237.603943:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260825856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784403237.727834:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403237.947302:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403237.947358:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403237.947431:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403237.947474:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403237.947513:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240873472 00000100:00100000:3.0:1784403237.947532:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240873472 00000100:00100000:2.0:1784403237.947538:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240873600 00000100:00100000:2.0:1784403237.947548:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240873600 00000100:00100000:0.0:1784403237.947653:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240873728 00000100:00100000:0.0:1784403237.947658:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240873728 00000100:00100000:2.0:1784403237.947752:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1784403237.947765:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2361:x1871082240873600:12345-192.168.204.28@tcp:400: 00000100:00100000:2.0:1784403237.947863:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2361:x1871082240873600:12345-192.168.204.28@tcp:400: Request processed in 102us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403237.947913:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1784403237.948100:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240873344 00000100:00100000:2.0:1784403237.948105:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240873344 00000100:00100000:2.0:1784403237.948134:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 167 00000100:00100000:2.0:1784403237.948141:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:2361:x1871082240873344:12345-192.168.204.28@tcp:400: 00000100:00100000:2.0:1784403237.948176:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:2361:x1871082240873344:12345-192.168.204.28@tcp:400: Request processed in 35us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403237.948183:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 167 00000100:00080000:1.0:1784403237.952841:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403237.953025:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:3.0:1784403237.953041:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240873472:12345-192.168.204.28@tcp:400: 00000100:00100000:3.0:1784403237.953144:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240873472:12345-192.168.204.28@tcp:400: Request processed in 107us (5714us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403237.953152:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:2.0:1784403237.953220:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:2.0:1784403237.953241:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2361:x1871082240873728:12345-192.168.204.28@tcp:400: 00000100:00100000:2.0:1784403237.953310:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2361:x1871082240873728:12345-192.168.204.28@tcp:400: Request processed in 78us (5836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403237.953318:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00080000:1.0:1784403237.953566:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784403237.953570:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403238.461991:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403238.462274:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240873856 00000100:00100000:0.0:1784403238.462286:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240873856 00000100:00100000:0.0:1784403238.462358:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 168 00000100:00100000:0.0:1784403238.462370:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:5576:x1871082240873856:12345-192.168.204.28@tcp:101: 00010000:00010000:0.0:1784403238.462390:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403238.462440:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce4a00/0x6828175665afa730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea02 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403238.462477:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce4a00/0x6828175665afa730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea02 expref: 9 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403238.462498:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce4a00/0x6828175665afa730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea02 expref: 9 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403238.462509:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4a00, rc 0) 00000100:00100000:0.0:1784403238.462586:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5576:x1871082240873856:12345-192.168.204.28@tcp:101: Request processed in 219us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403238.462594:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 168 00000100:00100000:3.0:1784403238.476455:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403238.477111:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240873984 00000100:00100000:2.0:1784403238.477192:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240873984 00000100:00100000:2.0:1784403238.477398:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 169 00000100:00100000:2.0:1784403238.477413:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5576:x1871082240873984:12345-192.168.204.28@tcp:501: 00000100:00100000:2.0:1784403238.477844:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5576:x1871082240873984:12345-192.168.204.28@tcp:501: Request processed in 434us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403238.477862:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 169 00000100:00100000:1.0:1784403238.480816:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403238.480993:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240874112 00000100:00100000:2.0:1784403238.481011:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240874112 00000100:00100000:2.0:1784403238.481094:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 170 00000100:00100000:2.0:1784403238.481106:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5576:x1871082240874112:12345-192.168.204.28@tcp:503: 00000100:00100000:2.0:1784403238.482969:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5576:x1871082240874112:12345-192.168.204.28@tcp:503: Request processed in 1848us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403238.482986:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 170 00000100:00100000:3.0:1784403238.492362:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403238.493714:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240874240 00000100:00100000:2.0:1784403238.493735:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240874240 00000100:00100000:2.0:1784403238.493825:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 171 00000100:00100000:2.0:1784403238.493838:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:6067:x1871082240874240:12345-192.168.204.28@tcp:502: 00000100:00100000:2.0:1784403238.494285:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:6067:x1871082240874240:12345-192.168.204.28@tcp:502: Request processed in 448us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403238.494295:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 171 00000100:00100000:3.0:1784403238.496293:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403238.497694:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240874368 00000100:00100000:2.0:1784403238.497714:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240874368 00000100:00100000:2.0:1784403238.497811:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00100000:2.0:1784403238.497824:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:6067:x1871082240874368:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784403238.500444:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:6067:x1871082240874368:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 2602us (4150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403238.500483:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00100000:1.0:1784403238.518613:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403238.519088:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240874496 00000100:00100000:0.0:1784403238.519099:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240874496 00000100:00100000:0.0:1784403238.519152:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:0.0:1784403238.519163:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5576:x1871082240874496:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403238.519182:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403238.519213:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce4e00/0x6828175665afa737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea09 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403238.520417:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce4e00/0x6828175665afa737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea09 expref: 10 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403238.520431:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce4e00/0x6828175665afa737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea09 expref: 10 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403238.520441:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4e00, rc 0) 00000100:00100000:0.0:1784403238.520525:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5576:x1871082240874496:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 1362us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403238.520534:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:0.0:1784403238.529142:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403238.529394:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240874624 00000100:00100000:2.0:1784403238.529405:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240874624 00000100:00100000:2.0:1784403238.529466:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 174 00000100:00100000:2.0:1784403238.529475:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5576:x1871082240874624:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403238.529977:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5576:x1871082240874624:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 500us (843us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784403238.529997:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 174 00010000:00010000:2.0:1784403238.752314:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784403239.570065:0:8870:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8e1331a0 20000000:00000080:0.0:1784403239.570090:0:8870:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c8a7368b800 uarg=0000000000000000 20000000:01000000:0.0:1784403239.570137:0:8870:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784403239.570145:0:8870:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784403239.570152:0:8870:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784403239.571904:0:8871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1784403239.572307:0:8870:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1784403239.577142:0:8870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1784403239.577199:0:8870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1784403239.577316:0:8870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1784403239.577336:0:8870:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784403239.577359:0:8870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403239.577382:0:8870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a40031200/0x6828175665afa4b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa4ac expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403239.577391:0:8870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a414ff600/0x6828175665afa515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa50e expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403239.577407:0:8870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a40031400/0x6828175665afa5e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa5d9 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403239.577418:0:8870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a40030400/0x6828175665afa69d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9d1 expref: 9 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403239.577426:0:8870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403239.577486:0:8870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a40030400/0x6828175665afa69d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9d1 expref: 9 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403239.577504:0:8870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a40030400/0x6828175665afa69d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9d1 expref: 9 pid: 6287 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403239.577521:0:8870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8870:1871082260825984:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403239.577720:0:8870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a40031400/0x6828175665afa5e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa5d9 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403239.577729:0:8870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a40031400/0x6828175665afa5e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa5d9 expref: 18 pid: 6286 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403239.577739:0:8870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8870:1871082260826112:0@lo:104: 00000100:00100000:0.0:1784403239.577782:0:8870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784403239.577909:0:8870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a414ff600/0x6828175665afa515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa50e expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403239.577917:0:8870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a414ff600/0x6828175665afa515 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa50e expref: 18 pid: 6286 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403239.577937:0:8870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8870:1871082260826240:0@lo:104: 00000100:00100000:0.0:1784403239.577963:0:8870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784403239.579192:0:8870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a40031200/0x6828175665afa4b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa4ac expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403239.579208:0:8870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a40031200/0x6828175665afa4b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa4ac expref: 18 pid: 6287 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403239.579219:0:8870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8870:1871082260826368:0@lo:104: 00000100:00100000:0.0:1784403239.579263:0:8870:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784403239.583997:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260826112 00000100:00100000:3.0:1784403239.584020:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260826112 00000100:00100000:3.0:1784403239.584088:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260826240 00000100:00100000:3.0:1784403239.584092:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260826240 00000100:00100000:3.0:1784403239.584118:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784403239.584128:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+4:8870:x1871082260826112:12345-0@lo:104: 00010000:00010000:3.0:1784403239.584151:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.584289:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784403239.584296:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+4:8870:x1871082260826112:12345-0@lo:104: Request processed in 170us (6513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403239.584306:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784403239.584329:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784403239.584337:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:8870:x1871082260826240:12345-0@lo:104: 00000100:00100000:2.0:1784403239.584341:0:8870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8870:1871082260826112:0@lo:104: 00010000:00010000:3.0:1784403239.584348:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.584389:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784403239.584427:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:8870:x1871082260826240:12345-0@lo:104: Request processed in 91us (6463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403239.584434:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784403239.584499:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403239.584506:0:8870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8870:1871082260826240:0@lo:104: 00000100:00100000:3.0:1784403239.584537:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260826368 00000100:00100000:3.0:1784403239.584541:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260826368 00000100:00100000:3.0:1784403239.584559:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784403239.584566:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:8870:x1871082260826368:12345-0@lo:104: 00010000:00010000:3.0:1784403239.584575:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ae00/0x6828175665afa4ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403239.584590:0:6274:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1784403239.584605:0:6274:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:3.0:1784403239.584626:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784403239.584633:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:8870:x1871082260826368:12345-0@lo:104: Request processed in 67us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403239.584639:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784403239.584813:0:8870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8870:1871082260826368:0@lo:104: 00000100:00100000:0.0:1784403239.584849:0:6274:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1784403239.586858:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784403239.586893:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.586908:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a41671200 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403239.586913:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.586927:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403239.586940:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403239.586947:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784403239.587161:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.587169:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784403239.587259:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784403239.587268:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403239.587276:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff400 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:2.0:1784403239.587280:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403239.587287:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784403239.587294:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403239.587300:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784403239.587329:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403239.587336:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403239.587838:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.587848:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a41671200/0x6828175665afa5d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa5e0 expref: -99 pid: 7989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.587941:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403239.587946:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ae00/0x6828175665afa4ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.587953:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a5b67ae00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403239.587957:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ae00/0x6828175665afa4ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.587965:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ae00/0x6828175665afa4ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403239.587973:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ae00/0x6828175665afa4ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403239.587979:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784403239.588002:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ae00/0x6828175665afa4ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.588009:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784403239.588033:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260826496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403239.588042:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ae00/0x6828175665afa4ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.588064:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a5b67ae00/0x6828175665afa4ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa4b3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.588075:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403239.588077:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403239.588079:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403239.588123:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403239.588184:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7749ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260826752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784403239.588247:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403239.588257:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a414ff400/0x6828175665afa50e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa515 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403239.588275:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403239.588277:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403239.588279:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403239.588326:0:8870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8870:1871082260825984:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403239.588362:0:8870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403239.589993:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260826624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784403239.590407:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403239.590467:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260826496 00000100:00100000:3.0:1784403239.590485:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260826496 00010000:00010000:3.0:1784403239.590539:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a40031400/0x6828175665afa5e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa5d9 expref: 19 pid: 6286 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403239.590576:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240874752 00000100:00100000:3.0:1784403239.590579:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240874752 00010000:00010000:3.0:1784403239.590593:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a40030400/0x6828175665afa69d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9d1 expref: 10 pid: 6287 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403239.590608:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784403239.590617:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260826496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403239.590636:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403239.590643:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a40031400/0x6828175665afa5e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa5d9 expref: 19 pid: 6286 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.590655:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a40031400/0x6828175665afa5e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa5d9 expref: 19 pid: 6286 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403239.591986:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784403239.592043:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a40031400/0x6828175665afa5e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa5d9 expref: 19 pid: 6286 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592095:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403239.592151:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+18:3565:x1871082260826496:12345-0@lo:103:ldlm_bl.0 Request processed in 1533us (4026us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403239.592162:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784403239.592189:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260826752 00010000:00010000:1.0:1784403239.592194:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403239.592196:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260826752 00010000:00010000:3.0:1784403239.592221:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a40031200/0x6828175665afa4b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa4ac expref: 18 pid: 6287 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403239.592245:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:0.0:1784403239.592252:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260826496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784403239.592258:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2361:x1871082240874752:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403239.592276:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403239.592282:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a40030400/0x6828175665afa69d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9d1 expref: 10 pid: 6287 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592299:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a40030400/0x6828175665afa69d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9d1 expref: 10 pid: 6287 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592318:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a40030400/0x6828175665afa69d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9d1 expref: 10 pid: 6287 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592330:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403239.592336:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403239.592399:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:2361:x1871082240874752:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 145us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403239.592407:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:3.0:1784403239.592422:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260826624 00000100:00100000:3.0:1784403239.592425:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260826624 00010000:00010000:3.0:1784403239.592445:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a414ff600/0x6828175665afa515 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa50e expref: 19 pid: 6286 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403239.592461:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784403239.592476:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260826752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403239.592485:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403239.592490:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a40031200/0x6828175665afa4b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa4ac expref: 19 pid: 6287 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592498:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a40031200/0x6828175665afa4b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa4ac expref: 19 pid: 6287 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592510:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a40031200/0x6828175665afa4b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa4ac expref: 19 pid: 6287 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592519:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403239.592561:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+18:3567:x1871082260826752:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403239.592568:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784403239.592585:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784403239.592591:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7749ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260826752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784403239.592595:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+17:3566:x1871082260826624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403239.592606:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403239.592611:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a414ff600/0x6828175665afa515 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa50e expref: 17 pid: 6286 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592620:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a414ff600/0x6828175665afa515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa50e expref: 17 pid: 6286 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592630:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a414ff600/0x6828175665afa515 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa50e expref: 17 pid: 6286 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592655:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.592665:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.594086:0:6277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.594103:0:6277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.594111:0:6277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.594119:0:6277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.594126:0:6277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403239.594130:0:6277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.594139:0:6277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.594165:0:6277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403239.594182:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403239.594212:0:8870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403239.594225:0:8870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403239.594234:0:8870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce4600/0x6828175665afa73e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403239.594284:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64472369-fee1-4bb4-a407-7797860a37a0+16:3566:x1871082260826624:12345-0@lo:103:ldlm_bl.0 Request processed in 1689us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403239.594311:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784403239.594742:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260826624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784403239.780920:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403240.161663:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784403240.161697:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260826880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403240.161803:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403240.162125:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260826880 00000100:00100000:2.0:1784403240.162146:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260826880 00000100:00100000:2.0:1784403240.162248:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784403240.162262:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260826880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403240.162313:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403240.162373:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260826880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403240.162381:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1784403240.162405:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784403240.162575:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a456bf480 x1871082260826880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403240.162599:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260826880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784403240.573321:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403240.573486:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240874880 00000100:00100000:2.0:1784403240.573501:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240874880 00000100:00100000:2.0:1784403240.573566:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 175 00000100:00100000:2.0:1784403240.573580:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:5576:x1871082240874880:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403240.573604:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403240.573631:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afa745 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea10 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403240.573669:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afa745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea10 expref: 10 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403240.573684:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afa745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea10 expref: 10 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403240.573696:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3400, rc 0) 00000100:00100000:2.0:1784403240.573769:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5576:x1871082240874880:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 191us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403240.573777:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 175 00000100:00100000:0.0:1784403240.580032:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403240.580120:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240875008 00000100:00100000:3.0:1784403240.580134:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240875008 00000100:00100000:3.0:1784403240.580213:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 176 00000100:00100000:3.0:1784403240.580225:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5576:x1871082240875008:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403240.580598:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5576:x1871082240875008:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 375us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403240.580608:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 176 00000100:00100000:0.0:1784403240.588381:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403240.588516:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240875136 00000100:00100000:0.0:1784403240.588529:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240875136 00000100:00100000:0.0:1784403240.588594:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00100000:0.0:1784403240.588743:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5576:x1871082240875136:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403240.589043:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:5576:x1871082240875136:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 304us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403240.596783:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00100000:0.0:1784403240.601495:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403240.602340:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240875264 00000100:00100000:2.0:1784403240.602356:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240875264 00000100:00100000:2.0:1784403240.602434:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 178 00000100:00100000:2.0:1784403240.602474:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:6124:x1871082240875264:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784403240.602801:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:6124:x1871082240875264:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 329us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403240.602810:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 178 00000100:00100000:2.0:1784403240.606123:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403240.606194:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240875392 00000100:00100000:0.0:1784403240.606206:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240875392 00000100:00100000:0.0:1784403240.606283:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 179 00000100:00100000:0.0:1784403240.606296:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:6124:x1871082240875392:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784403240.607635:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:6124:x1871082240875392:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 1333us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403240.607649:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 179 00010000:00010000:2.0:1784403240.800856:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784403241.183176:0:6290:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784403241.183186:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a42cc6000 from 4 10000000:01000000:2.0:1784403241.183192:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784403241.183240:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.183253:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.183265:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403241.183294:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.183371:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.183423:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784403241.183681:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260827008 00000100:00100000:0.0:1784403241.183689:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260827008 00000100:00100000:0.0:1784403241.183846:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784403241.183856:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260827008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403241.183882:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403241.184616:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa753 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa74c expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403241.184650:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa74c expref: 17 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403241.184677:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa74c expref: 17 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403241.184685:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5c00, rc 0) 00000100:00100000:0.0:1784403241.184761:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260827008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 905us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403241.184768:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784403241.186112:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403241.186139:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403241.186152:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403241.186238:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7749bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403241.186293:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403241.186331:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fda80 going to sleep for 11 seconds 00000100:00100000:3.0:1784403241.186352:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260827136 00000100:00100000:3.0:1784403241.186357:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260827136 00000100:00100000:3.0:1784403241.186400:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784403241.186408:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260827136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403241.189349:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260827136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2928us (3042us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403241.189377:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784403241.189436:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7749bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403241.189504:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784403241.189555:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403241.189591:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc25480 going to sleep for 11 seconds 00000100:00100000:3.0:1784403241.193789:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260827264 00000100:00100000:3.0:1784403241.193805:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260827264 00000100:00100000:3.0:1784403241.193863:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784403241.193940:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260827264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403241.194209:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260827264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 315us (4653us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403241.194218:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784403241.194289:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403241.195487:0:8929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77498000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8929:1871082260827392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403241.195617:0:8929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403241.195651:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260827392 00000100:00100000:3.0:1784403241.195656:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260827392 00000100:00100000:3.0:1784403241.195693:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1784403241.195701:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:8929:x1871082260827392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403241.196997:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:8929:x1871082260827392:12345-0@lo:502:llog_process_th.0 Request processed in 1287us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403241.197007:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1784403241.197065:0:8929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fd540 going to sleep for 11 seconds 00000100:00100000:3.0:1784403241.197089:0:8929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77498000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8929:1871082260827392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784403241.197120:0:8929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784403241.197129:0:8929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403241.197132:0:8929:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784403241.197139:0:8929:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a42cc6000 00000020:00000080:3.0:1784403241.197141:0:8929:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784403241.197227:0:8929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77498000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8929:1871082260827520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403241.197269:0:8929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403241.197292:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260827520 00000100:00100000:3.0:1784403241.197296:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260827520 00000100:00100000:3.0:1784403241.197322:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1784403241.197329:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:8929:x1871082260827520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403241.202024:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:8929:x1871082260827520:12345-0@lo:502:llog_process_th.0 Request processed in 4686us (4746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403241.202041:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1784403241.202121:0:8929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a51b159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403241.202149:0:8929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77498000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8929:1871082260827520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784403241.202188:0:8929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784403241.202197:0:8929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403241.202199:0:8929:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784403241.202206:0:8929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784403241.202395:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784403241.202416:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784403241.202427:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.202448:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403241.202473:0:6290:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784403241.202476:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a43036800 from 4 10000000:01000000:2.0:1784403241.202479:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784403241.202516:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.202524:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.202534:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403241.202571:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.202614:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.202640:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1240 going to sleep for 11 seconds 00000100:00100000:2.0:1784403241.202657:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260827648 00000100:00100000:2.0:1784403241.202662:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260827648 00000100:00100000:2.0:1784403241.202697:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1784403241.202705:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260827648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403241.202718:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403241.202731:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afa761 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa75a expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.202757:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afa761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa75a expref: 18 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.202768:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afa761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa75a expref: 18 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.202788:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2200, rc 0) 00000100:00100000:2.0:1784403241.202821:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260827648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403241.202827:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1784403241.202859:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403241.202895:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.202904:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403241.202952:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.202978:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.202997:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1240 going to sleep for 11 seconds 00000100:00100000:2.0:1784403241.203007:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260827776 00000100:00100000:2.0:1784403241.203010:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260827776 00000100:00100000:2.0:1784403241.203028:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784403241.203034:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260827776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.203271:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260827776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403241.203278:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784403241.203307:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.203331:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.203367:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.203388:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1240 going to sleep for 11 seconds 00000100:00100000:2.0:1784403241.203399:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260827904 00000100:00100000:2.0:1784403241.203403:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260827904 00000100:00100000:2.0:1784403241.203422:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1784403241.203428:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260827904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.203580:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260827904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403241.203588:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1784403241.203629:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260827904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.203800:0:8930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8930:1871082260828032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403241.203834:0:8930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.203852:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260828032 00000100:00100000:2.0:1784403241.203855:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260828032 00000100:00100000:2.0:1784403241.203901:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784403241.203908:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:8930:x1871082260828032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403241.204030:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:8930:x1871082260828032:12345-0@lo:502:llog_process_th.0 Request processed in 121us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403241.204036:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784403241.204071:0:8930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403241.204083:0:8930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8930:1871082260828032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784403241.204103:0:8930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784403241.204112:0:8930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403241.204114:0:8930:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784403241.204120:0:8930:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a43036800 00000020:00000080:2.0:1784403241.204123:0:8930:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784403241.204184:0:8930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8930:1871082260828160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403241.204224:0:8930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.204242:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260828160 00000100:00100000:2.0:1784403241.204246:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260828160 00000100:00100000:2.0:1784403241.204265:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784403241.204270:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:8930:x1871082260828160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403241.204372:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:8930:x1871082260828160:12345-0@lo:502:llog_process_th.0 Request processed in 101us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403241.204379:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784403241.204411:0:8930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403241.204423:0:8930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8930:1871082260828160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784403241.204452:0:8930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403241.204456:0:8930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403241.204458:0:8930:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784403241.204461:0:8930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784403241.204512:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784403241.204528:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784403241.204537:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.204547:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403241.204556:0:6290:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784403241.204559:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a5270b000 from 4 10000000:01000000:2.0:1784403241.204561:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784403241.204580:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.204589:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.204604:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403241.204617:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260828288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.204643:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.204656:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403241.204667:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260828288 00000100:00100000:2.0:1784403241.204670:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260828288 00000100:00100000:2.0:1784403241.204691:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1784403241.204697:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49cf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260828288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403241.204705:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403241.204717:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b3200/0x6828175665afa76f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa768 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.204735:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b3200/0x6828175665afa76f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa768 expref: 19 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.204746:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b3200/0x6828175665afa76f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa768 expref: 19 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.204754:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3200, rc 0) 00000100:00100000:2.0:1784403241.204781:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49cf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260828288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403241.204788:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1784403241.204814:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260828288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403241.204825:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.204839:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403241.204900:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260828416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.204924:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.204942:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403241.204951:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260828416 00000100:00100000:2.0:1784403241.204954:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260828416 00000100:00100000:2.0:1784403241.204973:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1784403241.204979:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49cf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260828416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.205170:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49cf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260828416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403241.205178:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1784403241.205206:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260828416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.205230:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260828544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.205262:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.205274:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403241.205286:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260828544 00000100:00100000:2.0:1784403241.205289:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260828544 00000100:00100000:2.0:1784403241.205309:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1784403241.205315:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260828544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.205430:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260828544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403241.205437:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1784403241.210775:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260828544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403241.213822:0:8932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8932:1871082260828672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403241.213931:0:8932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.213969:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260828672 00000100:00100000:2.0:1784403241.213974:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260828672 00000100:00100000:2.0:1784403241.214017:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784403241.214025:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:8932:x1871082260828672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403241.214237:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:8932:x1871082260828672:12345-0@lo:502:llog_process_th.0 Request processed in 211us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403241.214244:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784403241.214297:0:8932:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a52271b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784403241.214327:0:8932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8932:1871082260828672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784403241.214357:0:8932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784403241.214366:0:8932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403241.214368:0:8932:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784403241.214374:0:8932:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a5270b000 00000020:00000080:2.0:1784403241.214377:0:8932:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784403241.214464:0:8932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8932:1871082260828800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403241.214500:0:8932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403241.214523:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260828800 00000100:00100000:2.0:1784403241.214527:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260828800 00000100:00100000:2.0:1784403241.214549:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1784403241.214555:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:8932:x1871082260828800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403241.214669:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:8932:x1871082260828800:12345-0@lo:502:llog_process_th.0 Request processed in 113us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403241.214675:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1784403241.214709:0:8932:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43914d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784403241.214721:0:8932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:8932:1871082260828800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784403241.214738:0:8932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403241.214742:0:8932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403241.214743:0:8932:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784403241.214746:0:8932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784403241.214801:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784403241.214818:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784403241.214828:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403241.214839:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403241.824003:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403242.208991:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260828928:0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209079:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403242.209128:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260829440:0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209155:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403242.209182:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784403242.209188:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7749b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260829056:0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209208:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403242.209224:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260829568:0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209248:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403242.209277:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7749bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260829184:0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209302:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403242.209336:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784403242.209341:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7749ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260829312:0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209363:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403242.209395:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260829440 00000100:00100000:3.0:1784403242.209404:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260829440 00000100:00100000:3.0:1784403242.209468:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260829056 00000100:00100000:3.0:1784403242.209471:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260829056 00000100:00100000:3.0:1784403242.209485:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260829184 00000100:00100000:3.0:1784403242.209488:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260829184 00000100:00100000:3.0:1784403242.209503:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784403242.209511:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260829440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209566:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260829440:12345-0@lo:400:kworker.0 Request processed in 55us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403242.209574:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784403242.209591:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784403242.209596:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260829056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209621:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260829056:12345-0@lo:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403242.209626:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784403242.209636:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784403242.209641:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260829184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209672:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260829184:12345-0@lo:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403242.209678:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784403242.209701:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260829568 00000100:00100000:3.0:1784403242.209705:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260829568 00000100:00100000:3.0:1784403242.209731:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260829312 00000100:00100000:3.0:1784403242.209734:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260829312 00000100:00100000:3.0:1784403242.209782:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784403242.209788:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260829568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209820:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260829568:12345-0@lo:400:kworker.0 Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403242.209825:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784403242.209837:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784403242.209843:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260829312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209896:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260829312:12345-0@lo:400:kworker.0 Request processed in 52us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403242.209901:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1784403242.209924:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784403242.209928:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784403242.209931:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784403242.209967:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7749ad80 x1871082260829312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403242.209981:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7749ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260829312:0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.209991:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7749bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260829184:0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.210030:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7749b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260829056:0@lo:400:kworker.0 00010000:00080000:3.0:1784403242.210039:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77499180 x1871082260829568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403242.210047:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260829568:0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.210056:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260829440:0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.212984:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260828928 00000100:00100000:3.0:1784403242.213000:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260828928 00000100:00100000:3.0:1784403242.213073:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1784403242.213084:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260828928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403242.213181:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260828928:12345-0@lo:400:kworker.0 Request processed in 98us (4100us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403242.213190:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1784403242.213250:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260828928:0@lo:400:kworker.0 00000100:00100000:1.0:1784403242.719460:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784403242.719486:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260829696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403242.719582:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403242.720728:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260829696 00000100:00100000:2.0:1784403242.720739:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260829696 00000100:00100000:2.0:1784403242.720821:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784403242.720848:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260829696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403242.720933:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403242.721026:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260829696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403242.721034:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1784403242.722853:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7751ce00 x1871082260829696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403242.722913:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260829696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784403242.847233:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403243.071769:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403243.071903:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403243.071960:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403243.071993:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403243.072171:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240875904 00000100:00100000:1.0:1784403243.072418:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240875904 00000100:00100000:1.0:1784403243.072537:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240875776 00000100:00100000:1.0:1784403243.072541:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240875776 00000100:00100000:1.0:1784403243.072574:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1784403243.072584:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2361:x1871082240875904:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403243.072664:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2361:x1871082240875904:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 81us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403243.072672:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1784403243.072688:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:1.0:1784403243.072701:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2361:x1871082240875776:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403243.072728:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2361:x1871082240875776:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 28us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403243.072734:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00080000:0.0:1784403243.073317:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784403243.073322:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403243.073441:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240875648 00000100:00100000:3.0:1784403243.073448:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240875648 00000100:00100000:3.0:1784403243.073626:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:3.0:1784403243.073636:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240875648:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403243.073686:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240875648:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 52us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403243.073693:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:3.0:1784403243.073715:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240875520 00000100:00100000:3.0:1784403243.073719:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240875520 00000100:00100000:3.0:1784403243.073744:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 196 00000100:00100000:3.0:1784403243.073751:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2361:x1871082240875520:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403243.073775:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2361:x1871082240875520:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403243.073782:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 196 00000100:00080000:0.0:1784403243.075019:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784403243.872814:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403244.894980:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403245.288060:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403245.299379:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260829824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403245.299537:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403245.299654:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260829824 00000100:00100000:2.0:1784403245.299663:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260829824 00000100:00100000:2.0:1784403245.299752:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784403245.299761:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260829824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403245.299807:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403245.299960:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260829824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403245.300119:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1784403245.300147:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784403245.300187:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbd880 x1871082260829824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403245.300208:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260829824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784403245.919036:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784403246.369517:0:9170:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1784403246.944103:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403247.328530:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260830208:0@lo:400:kworker.0 00000100:00100000:2.0:1784403247.328641:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403247.328721:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403247.328727:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260830336:0@lo:400:kworker.0 00000100:00100000:2.0:1784403247.328756:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403247.328804:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260830208 00000100:00100000:2.0:1784403247.328813:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260830208 00000100:00100000:1.0:1784403247.329312:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260830080:0@lo:400:kworker.0 00000100:00100000:1.0:1784403247.329363:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403247.336990:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260829952:0@lo:400:kworker.0 00000100:00100000:0.0:1784403247.337100:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403247.337178:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260830464:0@lo:400:kworker.0 00000100:00100000:0.0:1784403247.337229:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260829952 00000100:00100000:0.0:1784403247.337238:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260829952 00000100:00100000:0.0:1784403247.337303:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784403247.337313:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260829952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403247.337392:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260829952:12345-0@lo:400:kworker.0 Request processed in 79us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403247.337401:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1784403247.345876:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260830080 00000100:00100000:2.0:1784403247.345900:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260830080 00000100:00100000:2.0:1784403247.345943:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260830336 00000100:00100000:2.0:1784403247.345947:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260830336 00000100:00100000:2.0:1784403247.346036:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784403247.346049:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260830336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403247.346297:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784403247.346310:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260830208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403247.346411:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260830208:12345-0@lo:400:kworker.0 Request processed in 105us (17770us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403247.346419:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784403247.346495:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403247.346559:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260829952:0@lo:400:kworker.0 00000100:00100000:1.0:1784403247.346587:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260830464 00000100:00100000:1.0:1784403247.346591:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260830464 00000100:00100000:1.0:1784403247.346616:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784403247.346622:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260830464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403247.346664:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260830464:12345-0@lo:400:kworker.0 Request processed in 42us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403247.346671:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784403247.346698:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260830464:0@lo:400:kworker.0 00000100:00100000:1.0:1784403247.346722:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260830208:0@lo:400:kworker.0 00000100:00100000:1.0:1784403247.346748:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260830592:0@lo:400:kworker.0 00000100:00100000:1.0:1784403247.346799:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403247.346824:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260830592 00000100:00100000:1.0:1784403247.346828:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260830592 00000100:00100000:1.0:1784403247.346855:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784403247.346862:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260830592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403247.346973:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260830592:12345-0@lo:400:kworker.0 Request processed in 111us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403247.346980:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1784403247.347011:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a456bce00 x1871082260830592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403247.347023:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260830592:0@lo:400:kworker.0 00000100:00100000:2.0:1784403247.351631:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260830336:12345-0@lo:400:kworker.0 Request processed in 5570us (22859us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403247.351663:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1784403247.351724:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403247.351731:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784403247.351736:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403247.351805:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784403247.351815:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260830080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403247.351904:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260830080:12345-0@lo:400:kworker.0 Request processed in 90us (22541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403247.351911:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1784403247.352227:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a456be680 x1871082260830336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403247.352246:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260830336:0@lo:400:kworker.0 00000100:00100000:1.0:1784403247.352291:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260830080:0@lo:400:kworker.0 00000100:00100000:2.0:1784403247.840691:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784403247.840725:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260830720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784403247.840825:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403247.841034:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260830720 00000100:00100000:3.0:1784403247.841045:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260830720 00000100:00100000:3.0:1784403247.841124:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784403247.841139:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260830720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403247.841239:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403247.841303:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260830720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403247.841312:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1784403247.841599:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7751ea00 x1871082260830720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403247.841627:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260830720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784403247.967099:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403248.194015:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403248.194081:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403248.194135:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240876160 00000100:00100000:0.0:1784403248.194148:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240876160 00000100:00100000:0.0:1784403248.194239:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:0.0:1784403248.194252:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2359:x1871082240876160:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403248.194366:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2359:x1871082240876160:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 117us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403248.194374:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00080000:0.0:1784403248.194411:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403248.195365:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240876032 00000100:00100000:3.0:1784403248.195379:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240876032 00000100:00100000:3.0:1784403248.195457:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 198 00000100:00100000:3.0:1784403248.195468:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2359:x1871082240876032:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403248.195540:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2359:x1871082240876032:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 74us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403248.195549:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 198 00000100:00100000:0.0:1784403248.207263:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403248.207332:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403248.207376:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240876288 00000100:00100000:0.0:1784403248.207388:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240876288 00000100:00100000:1.0:1784403248.207399:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240876416 00000100:00100000:1.0:1784403248.207403:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240876416 00000100:00100000:0.0:1784403248.207468:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:0.0:1784403248.207479:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2357:x1871082240876288:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:0.0:1784403248.207524:0:8571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa6ab 00000100:00080000:0.0:1784403248.207534:0:8571:0:(import.c:65:import_set_state_nolock()) ffff8c8a453be000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784403248.207582:0:8571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1784403248.208412:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+2:2357:x1871082240876288:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 928us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403248.208425:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00010000:00010000:0.0:1784403248.208465:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403248.210096:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:1.0:1784403248.210114:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2357:x1871082240876416:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:1.0:1784403248.210452:0:7101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa6b2 00000100:00080000:1.0:1784403248.210467:0:7101:0:(import.c:65:import_set_state_nolock()) ffff8c8a77d55800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784403248.210520:0:7101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1784403248.210781:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403248.211550:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+2:2357:x1871082240876416:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 1432us (4207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403248.211572:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00080000:0.0:1784403248.213802:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784403248.213813:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784403248.993996:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403250.015165:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403250.405654:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784403250.405689:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260830848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784403250.405787:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403250.405956:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260830848 00000100:00100000:1.0:1784403250.405968:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260830848 00000100:00100000:1.0:1784403250.406051:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784403250.406063:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260830848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784403250.406111:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403250.406173:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260830848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403250.406181:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1784403250.406234:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbd180 x1871082260830848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403250.406253:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260830848:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784403250.406329:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784403251.040248:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784403251.464800:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000020:00000080:3.0:1784403251.464814:0:7124:0:(genops.c:885:class_export_put()) final put ffff8c8a453bd000/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000020:00000080:2.0:1784403251.464908:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a453bd000/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 for lustre-OST0000 00000020:00000080:2.0:1784403251.464962:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a453be000 for lustre-OST0000 00000001:00100000:3.0:1784403251.470757:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000020:00000080:3.0:1784403251.470769:0:8006:0:(genops.c:885:class_export_put()) final put ffff8c8a77d53800/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000020:00000080:2.0:1784403251.470858:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a77d53800/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 for lustre-OST0001 00000020:00000080:2.0:1784403251.474164:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a77d55800 for lustre-OST0001 00000001:02000400:2.0:1784403251.741994:0:9417:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing yml_node 00010000:00010000:0.0:1784403252.065129:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403252.454129:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260831104:0@lo:400:kworker.0 00000100:00100000:2.0:1784403252.454224:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403252.454303:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260831616:0@lo:400:kworker.0 00000100:00100000:1.0:1784403252.454646:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260830976:0@lo:400:kworker.0 00000100:00100000:1.0:1784403252.454690:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403252.454726:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260831488:0@lo:400:kworker.0 00000100:00100000:1.0:1784403252.454750:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403252.456516:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260830976 00000100:00100000:0.0:1784403252.456537:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260830976 00000100:00100000:0.0:1784403252.456635:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784403252.456666:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260830976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403252.456778:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260830976:12345-0@lo:400:kworker.0 Request processed in 114us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403252.456785:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784403252.456830:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260831104 00000100:00100000:0.0:1784403252.456834:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260831104 00000100:00100000:0.0:1784403252.456890:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260831488 00000100:00100000:0.0:1784403252.456894:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260831488 00000100:00100000:0.0:1784403252.456924:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784403252.456930:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260831104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403252.456969:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260831104:12345-0@lo:400:kworker.0 Request processed in 38us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403252.456975:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784403252.456987:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784403252.456994:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260831488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403252.457022:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260831488:12345-0@lo:400:kworker.0 Request processed in 29us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403252.457028:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1784403252.457046:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403252.457085:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260830976:0@lo:400:kworker.0 00000100:00100000:0.0:1784403252.457101:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260831488:0@lo:400:kworker.0 00000100:00100000:2.0:1784403252.457594:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403252.457657:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260831104:0@lo:400:kworker.0 00000100:00100000:2.0:1784403252.457690:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260831232:0@lo:400:kworker.0 00000100:00100000:2.0:1784403252.457728:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403252.457750:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403252.457758:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260831360:0@lo:400:kworker.0 00000100:00100000:2.0:1784403252.457782:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403252.457818:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260831232 00000100:00100000:2.0:1784403252.457823:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260831232 00000100:00100000:2.0:1784403252.457862:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784403252.457887:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260831232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403252.457929:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260831232:12345-0@lo:400:kworker.0 Request processed in 43us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403252.457936:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784403252.457957:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260831616 00000100:00100000:2.0:1784403252.457961:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260831616 00000100:00100000:2.0:1784403252.457988:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260831360 00000100:00100000:2.0:1784403252.457991:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260831360 00000100:00100000:2.0:1784403252.458013:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784403252.458019:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260831616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403252.458054:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260831616:12345-0@lo:400:kworker.0 Request processed in 34us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403252.458059:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784403252.458071:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784403252.458076:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260831360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403252.458104:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260831360:12345-0@lo:400:kworker.0 Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403252.458122:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1784403252.458143:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784403252.458146:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403252.458149:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784403252.458172:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a456be680 x1871082260831360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403252.458184:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260831360:0@lo:400:kworker.0 00000100:00100000:2.0:1784403252.458194:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260831232:0@lo:400:kworker.0 00010000:00080000:2.0:1784403252.458227:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a456bd880 x1871082260831616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403252.458249:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260831616:0@lo:400:kworker.0 00000100:00100000:2.0:1784403252.959101:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784403252.959128:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260831744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784403252.959216:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403252.959359:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260831744 00000100:00100000:1.0:1784403252.959369:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260831744 00000100:00100000:1.0:1784403252.959433:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784403252.959443:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260831744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784403252.959489:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403252.959546:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260831744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403252.959554:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1784403252.959682:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a456bd880 x1871082260831744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403252.959703:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260831744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784403253.093461:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403253.309634:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403253.310278:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403253.310356:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240876672 00000100:00100000:1.0:1784403253.310369:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240876672 00000100:00100000:2.0:1784403253.310381:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240876544 00000100:00100000:2.0:1784403253.310385:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240876544 00000100:00100000:2.0:1784403253.310444:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 200 00000100:00100000:1.0:1784403253.310444:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:2.0:1784403253.310455:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2359:x1871082240876544:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403253.310455:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2359:x1871082240876672:12345-192.168.204.28@tcp:400:kworker.0 00000100:00080000:0.0:1784403253.310542:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403253.310545:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2359:x1871082240876544:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 92us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403253.310577:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 200 00000100:00100000:1.0:1784403253.313792:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2359:x1871082240876672:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 3321us (3768us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403253.313812:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00010000:00010000:2.0:1784403254.112900:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403255.135315:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784403255.438839:0:9608:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.174 00000100:00100000:3.0:1784403255.520355:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784403255.520386:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260831872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784403255.520494:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403255.520596:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260831872 00000100:00100000:3.0:1784403255.520607:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260831872 00000100:00100000:3.0:1784403255.520678:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784403255.520708:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260831872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784403255.520760:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403255.520815:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260831872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403255.520823:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1784403255.521096:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784403255.521138:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77498a80 x1871082260831872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403255.521161:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260831872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784403256.163032:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403257.185002:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403257.567286:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260832384:0@lo:400:kworker.0 00000100:00100000:2.0:1784403257.567423:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403257.567502:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784403257.567509:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260832256:0@lo:400:kworker.0 00000100:00100000:2.0:1784403257.567537:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403257.567577:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260832384 00000100:00100000:2.0:1784403257.567586:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260832384 00000100:00100000:2.0:1784403257.567676:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784403257.567689:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260832384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403257.567750:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260832384:12345-0@lo:400:kworker.0 Request processed in 64us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403257.567758:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784403257.567786:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260832256 00000100:00100000:2.0:1784403257.567790:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260832256 00000100:00100000:2.0:1784403257.567818:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784403257.567825:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260832256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403257.567858:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260832256:12345-0@lo:400:kworker.0 Request processed in 33us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403257.567896:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1784403257.567913:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784403257.567917:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403257.567956:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260832256:0@lo:400:kworker.0 00010000:00080000:2.0:1784403257.567971:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a456bfb80 x1871082260832384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403257.567990:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260832384:0@lo:400:kworker.0 00000100:00100000:0.0:1784403257.568272:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260832000:0@lo:400:kworker.0 00000100:00100000:0.0:1784403257.568317:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403257.568356:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260832512:0@lo:400:kworker.0 00000100:00100000:0.0:1784403257.568381:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403257.568400:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784403257.568406:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260832128:0@lo:400:kworker.0 00000100:00100000:0.0:1784403257.568428:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403257.568448:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260832640:0@lo:400:kworker.0 00000100:00100000:0.0:1784403257.568468:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403257.568500:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260832640 00000100:00100000:0.0:1784403257.568505:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260832640 00000100:00100000:0.0:1784403257.568544:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784403257.568552:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260832640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403257.568595:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260832640:12345-0@lo:400:kworker.0 Request processed in 43us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403257.568603:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1784403257.568627:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784403257.568635:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260832512 00000100:00100000:0.0:1784403257.568638:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260832512 00000100:00100000:0.0:1784403257.568661:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260832128 00000100:00100000:0.0:1784403257.568664:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260832128 00000100:00100000:0.0:1784403257.568677:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784403257.568683:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260832512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403257.568712:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260832512:12345-0@lo:400:kworker.0 Request processed in 30us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403257.568719:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784403257.568730:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784403257.568749:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260832128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403257.568779:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260832128:12345-0@lo:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403257.568784:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1784403257.568800:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403257.568821:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260832128:0@lo:400:kworker.0 00010000:00080000:0.0:1784403257.568832:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a456bea00 x1871082260832640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403257.568843:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260832640:0@lo:400:kworker.0 00000100:00100000:0.0:1784403257.568860:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260832512:0@lo:400:kworker.0 00000100:00100000:1.0:1784403257.569026:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260832000 00000100:00100000:1.0:1784403257.569032:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260832000 00000100:00100000:1.0:1784403257.569073:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1784403257.569080:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260832000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403257.569119:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260832000:12345-0@lo:400:kworker.0 Request processed in 40us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403257.569125:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1784403257.569403:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260832000:0@lo:400:kworker.0 00000100:00100000:1.0:1784403258.081162:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260832768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403258.081271:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403258.081372:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260832768 00000100:00100000:1.0:1784403258.081383:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260832768 00000100:00100000:1.0:1784403258.081453:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784403258.081465:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260832768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784403258.081522:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403258.081599:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260832768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403258.081607:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1784403258.081663:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbdf80 x1871082260832768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403258.081701:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260832768:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1784403258.142946:0:9708:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.174 00010000:00010000:3.0:1784403258.212736:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403258.428821:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403258.428898:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403258.428943:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240876928 00000100:00100000:3.0:1784403258.428956:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240876928 00000100:00100000:3.0:1784403258.429052:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:3.0:1784403258.429068:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240876928:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403258.429187:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240876928:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 123us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403258.429196:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00080000:3.0:1784403258.429222:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403258.430615:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240876800 00000100:00100000:0.0:1784403258.430629:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240876800 00000100:00100000:0.0:1784403258.430702:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 202 00000100:00100000:0.0:1784403258.430712:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240876800:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403258.430800:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240876800:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 89us (1996us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403258.430808:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 202 00010000:00010000:0.0:1784403259.231988:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403260.257931:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403260.645241:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260832896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403260.645349:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403260.645477:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260832896 00000100:00100000:3.0:1784403260.645488:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260832896 00000100:00100000:3.0:1784403260.645573:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784403260.645587:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260832896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784403260.645638:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403260.651036:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260832896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5437us (5672us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403260.651058:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1784403260.651122:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784403260.656791:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbdf80 x1871082260832896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403260.656832:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260832896:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1784403261.084655:0:9805:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.174 00010000:00010000:1.0:1784403261.285219:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403262.303620:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403262.687275:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260833152:0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.687382:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403262.687479:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260833664:0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.687510:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403262.687559:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784403262.687566:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260833024:0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.687599:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403262.687627:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260833536:0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.687664:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403262.687705:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260833280:0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.687758:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403262.687785:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784403262.687791:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260833408:0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.687814:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403262.687843:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260833024 00000100:00100000:0.0:1784403262.687853:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260833024 00000100:00100000:0.0:1784403262.687949:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784403262.687960:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260833024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.688019:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260833024:12345-0@lo:400:kworker.0 Request processed in 59us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403262.688028:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784403262.688075:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260833152 00000100:00100000:0.0:1784403262.688079:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260833152 00000100:00100000:0.0:1784403262.688098:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260833536 00000100:00100000:0.0:1784403262.688101:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260833536 00000100:00100000:0.0:1784403262.688126:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260833280 00000100:00100000:0.0:1784403262.688129:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260833280 00000100:00100000:0.0:1784403262.688144:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784403262.688150:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260833152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.688194:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260833152:12345-0@lo:400:kworker.0 Request processed in 44us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403262.688200:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784403262.688214:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784403262.688219:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260833536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.688239:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260833536:12345-0@lo:400:kworker.0 Request processed in 21us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403262.688244:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784403262.688254:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784403262.688258:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260833280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.688282:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260833280:12345-0@lo:400:kworker.0 Request processed in 23us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403262.688286:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1784403262.688304:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403262.688338:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260833280:0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.688365:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260833024:0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.688373:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260833536:0@lo:400:kworker.0 00000100:00100000:0.0:1784403262.688382:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260833152:0@lo:400:kworker.0 00000100:00100000:2.0:1784403262.688486:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260833664 00000100:00100000:2.0:1784403262.688490:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260833664 00000100:00100000:2.0:1784403262.688532:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260833408 00000100:00100000:2.0:1784403262.688535:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260833408 00000100:00100000:2.0:1784403262.688558:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784403262.688565:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260833664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403262.688607:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260833664:12345-0@lo:400:kworker.0 Request processed in 42us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403262.688612:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784403262.688624:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784403262.688629:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260833408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403262.688661:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260833408:12345-0@lo:400:kworker.0 Request processed in 32us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403262.688666:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1784403262.688705:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7751c380 x1871082260833408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403262.688716:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260833408:0@lo:400:kworker.0 00010000:00080000:2.0:1784403262.688751:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7751d500 x1871082260833664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403262.688760:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260833664:0@lo:400:kworker.0 00000100:00080000:0.0:1784403262.689898:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784403262.689907:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1784403263.068508:0:9853:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Jul 18 15:34:21 EDT 2026 00000100:00100000:3.0:1784403263.199198:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784403263.199225:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260833792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403263.199305:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403263.206373:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260833792 00000100:00100000:1.0:1784403263.206389:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260833792 00000100:00100000:1.0:1784403263.206462:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784403263.206474:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260833792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784403263.206519:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403263.206612:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260833792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (7306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403263.206621:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1784403263.206690:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbea00 x1871082260833792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403263.206713:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260833792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784403263.327220:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403263.550199:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403263.550401:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403263.550537:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240877056 00000100:00100000:1.0:1784403263.550547:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240877056 00000100:00100000:1.0:1784403263.550614:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 204 00000100:00100000:1.0:1784403263.550625:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2361:x1871082240877056:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403263.550705:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2361:x1871082240877056:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403263.550713:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 204 00000100:00100000:0.0:1784403263.551003:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240877184 00000100:00100000:0.0:1784403263.551009:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240877184 00000100:00100000:0.0:1784403263.551073:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:0.0:1784403263.551095:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240877184:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403263.551149:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240877184:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 56us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403263.551156:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00080000:3.0:1784403263.551351:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784403264.355438:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403265.375281:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403265.759105:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784403265.759140:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260833920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403265.759229:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403265.759354:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260833920 00000100:00100000:1.0:1784403265.759367:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260833920 00000100:00100000:1.0:1784403265.759451:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784403265.759464:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260833920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784403265.759528:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403265.759583:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260833920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403265.759592:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1784403265.759716:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784403265.759756:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbea00 x1871082260833920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403265.759778:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260833920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784403266.403322:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403267.423185:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403267.807415:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260834432:0@lo:400:kworker.0 00000100:00100000:0.0:1784403267.807514:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403267.807607:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784403267.807615:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260834304:0@lo:400:kworker.0 00000100:00100000:0.0:1784403267.807645:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403267.807680:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260834432 00000100:00100000:0.0:1784403267.807701:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260834432 00000100:00100000:2.0:1784403267.807832:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260834048:0@lo:400:kworker.0 00000100:00100000:2.0:1784403267.807906:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403267.807933:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260834560:0@lo:400:kworker.0 00000100:00100000:2.0:1784403267.807973:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403267.807993:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784403267.807999:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260834176:0@lo:400:kworker.0 00000100:00100000:2.0:1784403267.808022:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403267.808040:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260834688:0@lo:400:kworker.0 00000100:00100000:2.0:1784403267.808063:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403267.808093:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260834304 00000100:00100000:2.0:1784403267.808097:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260834304 00000100:00100000:3.0:1784403267.808319:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260834560 00000100:00100000:3.0:1784403267.808326:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260834560 00000100:00100000:2.0:1784403267.808340:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260834176 00000100:00100000:2.0:1784403267.808356:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260834176 00000100:00100000:3.0:1784403267.808378:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784403267.808476:0:6292:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1784403267.808488:0:6292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1784403267.808508:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260834048 00000100:00100000:1.0:1784403267.808512:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260834048 00000100:00100000:1.0:1784403267.808543:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1784403267.808550:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260834048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403267.808641:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260834048:12345-0@lo:400:kworker.0 Request processed in 90us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403267.808650:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:1.0:1784403267.808813:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403267.808897:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260834304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403267.808958:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260834304:12345-0@lo:400:kworker.0 Request processed in 568us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403267.809244:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260834688 00000100:00100000:0.0:1784403267.809249:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260834688 00000100:00100000:0.0:1784403267.809277:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784403267.809285:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260834432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403267.809326:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260834432:12345-0@lo:400:kworker.0 Request processed in 42us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403267.809332:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784403267.809367:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784403267.809373:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260834688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403267.809404:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260834688:12345-0@lo:400:kworker.0 Request processed in 32us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403267.809410:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1784403267.809430:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784403267.809433:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403267.812849:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784403267.812902:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260834560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403267.813051:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260834560:12345-0@lo:400:kworker.0 Request processed in 169us (5076us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403267.813061:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784403267.813098:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784403267.813124:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260834176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403267.813228:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260834176:12345-0@lo:400:kworker.0 Request processed in 117us (5205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403267.813237:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784403267.813392:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784403267.813493:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260834176:0@lo:400:kworker.0 00010000:00080000:2.0:1784403267.814273:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1c000 x1871082260834688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403267.814314:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260834688:0@lo:400:kworker.0 00000100:00100000:2.0:1784403267.815166:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260834048:0@lo:400:kworker.0 00000100:00100000:3.0:1784403267.815175:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260834304:0@lo:400:kworker.0 00000100:00100000:2.0:1784403267.815194:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260834560:0@lo:400:kworker.0 00010000:00080000:3.0:1784403267.815209:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1d500 x1871082260834432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403267.815225:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260834432:0@lo:400:kworker.0 00000100:00100000:2.0:1784403268.342913:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784403268.342948:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260834816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784403268.343022:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403268.343087:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260834816 00000100:00100000:2.0:1784403268.343094:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260834816 00000100:00100000:2.0:1784403268.343141:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784403268.343151:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260834816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403268.343188:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403268.343233:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260834816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403268.343240:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1784403268.343298:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e18700 x1871082260834816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403268.343318:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260834816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784403268.447091:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403268.667650:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403268.667754:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403268.667996:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240877312 00000100:00100000:3.0:1784403268.668007:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240877312 00000100:00100000:3.0:1784403268.668163:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 206 00000100:00100000:3.0:1784403268.668182:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240877312:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403268.668259:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240877312:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 78us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403268.668267:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 206 00000100:00100000:2.0:1784403268.668593:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240877440 00000100:00100000:2.0:1784403268.668599:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240877440 00000100:00100000:2.0:1784403268.668654:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:2.0:1784403268.668662:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240877440:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403268.668703:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240877440:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 42us (948us total) trans 0 rc 0/0 00000100:00080000:1.0:1784403268.668832:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403268.668895:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00010000:00010000:3.0:1784403269.471145:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403270.499111:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403270.879199:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784403270.879225:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260834944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403270.879380:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403270.879553:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260834944 00000100:00100000:1.0:1784403270.879561:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260834944 00000100:00100000:1.0:1784403270.879627:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784403270.879638:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260834944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784403270.879684:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403270.879729:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260834944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403270.879748:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1784403270.879772:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784403270.880822:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbca80 x1871082260834944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403270.880847:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260834944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784403271.527416:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403272.544005:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403272.929906:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260835072:0@lo:400:kworker.0 00000100:00100000:2.0:1784403272.929991:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403272.930056:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260835584:0@lo:400:kworker.0 00000100:00100000:2.0:1784403272.930103:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403272.930136:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784403272.930143:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260835200:0@lo:400:kworker.0 00000100:00100000:2.0:1784403272.930165:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403272.930180:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260835712:0@lo:400:kworker.0 00000100:00100000:2.0:1784403272.930205:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403272.930240:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260835584 00000100:00100000:2.0:1784403272.930246:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260835584 00000100:00100000:2.0:1784403272.930299:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260835200 00000100:00100000:2.0:1784403272.930303:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260835200 00000100:00100000:2.0:1784403272.930326:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784403272.930335:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260835584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403272.930386:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260835584:12345-0@lo:400:kworker.0 Request processed in 53us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403272.930393:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784403272.930409:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784403272.930414:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260835200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403272.930438:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260835200:12345-0@lo:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403272.930443:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784403272.930476:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260835712 00000100:00100000:2.0:1784403272.930479:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260835712 00000100:00100000:2.0:1784403272.930518:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784403272.930525:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260835712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403272.930556:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260835712:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403272.930563:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1784403272.930579:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403272.930583:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403272.930624:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260835200:0@lo:400:kworker.0 00010000:00080000:2.0:1784403272.930653:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbc000 x1871082260835712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403272.930664:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260835712:0@lo:400:kworker.0 00000100:00100000:2.0:1784403272.930672:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260835584:0@lo:400:kworker.0 00000100:00100000:3.0:1784403272.930819:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260835456:0@lo:400:kworker.0 00000100:00100000:3.0:1784403272.930863:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403272.930922:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784403272.930929:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260835328:0@lo:400:kworker.0 00000100:00100000:3.0:1784403272.930954:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403272.930979:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260835328 00000100:00100000:3.0:1784403272.930983:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260835328 00000100:00100000:3.0:1784403272.931014:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784403272.931021:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260835328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403272.931055:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260835328:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403272.931061:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1784403272.931077:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403272.931094:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260835328:0@lo:400:kworker.0 00000100:00100000:1.0:1784403272.931238:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260835072 00000100:00100000:1.0:1784403272.931243:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260835072 00000100:00100000:1.0:1784403272.931282:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1784403272.931291:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260835072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403272.931332:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260835072:12345-0@lo:400:kworker.0 Request processed in 43us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403272.931338:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1784403272.933176:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260835456 00000100:00100000:2.0:1784403272.933190:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260835456 00000100:00100000:2.0:1784403272.933359:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784403272.933370:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260835456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403272.933463:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260835456:12345-0@lo:400:kworker.0 Request processed in 95us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403272.933478:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784403272.933527:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260835072:0@lo:400:kworker.0 00000100:00080000:3.0:1784403272.933972:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784403272.935405:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbd880 x1871082260835456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403272.935422:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260835456:0@lo:400:kworker.0 00000100:00100000:1.0:1784403273.439178:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784403273.447684:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260835840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403273.448446:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403273.448562:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260835840 00000100:00100000:3.0:1784403273.448572:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260835840 00000100:00100000:3.0:1784403273.448641:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784403273.448652:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260835840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403273.448706:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403273.448782:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260835840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403273.448803:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1784403273.455937:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e19c00 x1871082260835840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403273.456611:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260835840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784403273.572029:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403273.790329:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403273.790380:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403273.790449:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240877696 00000100:00100000:2.0:1784403273.790458:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240877696 00000100:00100000:2.0:1784403273.790544:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:2.0:1784403273.790566:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240877696:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403273.790670:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240877696:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 115us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403273.790678:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:3.0:1784403273.791310:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240877568 00000100:00100000:3.0:1784403273.791316:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240877568 00000100:00100000:3.0:1784403273.791361:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 208 00000100:00100000:3.0:1784403273.791370:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2358:x1871082240877568:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403273.791412:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2358:x1871082240877568:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 44us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403273.791420:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 208 00000100:00080000:0.0:1784403273.792367:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784403274.597361:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403275.615055:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403276.004032:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784403276.004059:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260835968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784403276.004131:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403276.005590:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260835968 00000100:00100000:3.0:1784403276.005604:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260835968 00000100:00100000:3.0:1784403276.005671:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784403276.005683:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260835968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784403276.005736:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403276.005823:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260835968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403276.005831:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1784403276.005887:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784403276.007024:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbd500 x1871082260835968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403276.007071:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260835968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784403276.649676:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403277.670717:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403278.047633:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260836480:0@lo:400:kworker.0 00000100:00100000:0.0:1784403278.047712:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403278.047805:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784403278.047814:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260836352:0@lo:400:kworker.0 00000100:00100000:0.0:1784403278.047920:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403278.048086:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260836224:0@lo:400:kworker.0 00000100:00100000:2.0:1784403278.048205:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260836096:0@lo:400:kworker.0 00000100:00100000:2.0:1784403278.048244:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403278.048279:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260836608:0@lo:400:kworker.0 00000100:00100000:2.0:1784403278.048310:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260836480 00000100:00100000:2.0:1784403278.048317:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260836480 00000100:00100000:2.0:1784403278.048373:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784403278.048382:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260836480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403278.048433:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260836480:12345-0@lo:400:kworker.0 Request processed in 53us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403278.048441:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1784403278.048461:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403278.048642:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260836096 00000100:00100000:3.0:1784403278.048647:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260836096 00000100:00100000:3.0:1784403278.048686:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1784403278.048695:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260836096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403278.048739:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260836096:12345-0@lo:400:kworker.0 Request processed in 46us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403278.048772:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00080000:0.0:1784403278.049114:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1ce00 x1871082260836480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403278.049129:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260836480:0@lo:400:kworker.0 00000100:00100000:1.0:1784403278.049207:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403278.053747:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260836736:0@lo:400:kworker.0 00000100:00100000:1.0:1784403278.053836:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403278.053983:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260836736 00000100:00100000:2.0:1784403278.053992:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260836736 00000100:00100000:2.0:1784403278.054065:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784403278.054076:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260836736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403278.054135:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260836736:12345-0@lo:400:kworker.0 Request processed in 61us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403278.054143:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784403278.054172:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784403278.054374:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784403278.054412:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1ed80 x1871082260836736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403278.054429:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260836736:0@lo:400:kworker.0 00000100:00100000:3.0:1784403278.057791:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260836352 00000100:00100000:3.0:1784403278.057807:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260836352 00000100:00100000:3.0:1784403278.057910:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260836224 00000100:00100000:3.0:1784403278.057913:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260836224 00000100:00080000:1.0:1784403278.058651:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784403278.058703:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784403278.058719:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260836352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403278.058843:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260836352:12345-0@lo:400:kworker.0 Request processed in 129us (10921us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403278.058851:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784403278.058954:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260836352:0@lo:400:kworker.0 00000100:00100000:3.0:1784403278.060113:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784403278.060129:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260836224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403278.060296:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260836224:12345-0@lo:400:kworker.0 Request processed in 172us (11087us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403278.060304:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784403278.060352:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260836224:0@lo:400:kworker.0 00000100:00100000:2.0:1784403278.061363:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260836096:0@lo:400:kworker.0 00000100:00100000:0.0:1784403278.061803:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260836608 00000100:00100000:0.0:1784403278.061813:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260836608 00000100:00080000:2.0:1784403278.061920:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784403278.068335:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784403278.068363:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260836608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403278.068469:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260836608:12345-0@lo:400:kworker.0 Request processed in 120us (14296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403278.068477:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784403278.068680:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260836608:0@lo:400:kworker.0 00000100:00100000:1.0:1784403278.562357:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260836864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403278.562436:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403278.562599:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260836864 00000100:00100000:3.0:1784403278.562607:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260836864 00000100:00100000:3.0:1784403278.562667:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784403278.562677:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260836864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403278.562719:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403278.562782:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260836864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403278.562789:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1784403278.563092:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e19180 x1871082260836864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403278.563114:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260836864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784403278.687055:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403278.907063:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403278.907158:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240877952 00000100:00100000:1.0:1784403278.907168:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240877952 00000100:00100000:1.0:1784403278.907257:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:1.0:1784403278.907268:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240877952:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403278.907352:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240877952:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 85us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403278.907360:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00080000:2.0:1784403278.907431:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403278.914456:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403278.914575:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240877824 00000100:00100000:1.0:1784403278.914586:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240877824 00000100:00100000:1.0:1784403278.914689:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 210 00000100:00100000:1.0:1784403278.914701:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2359:x1871082240877824:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403278.914797:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2359:x1871082240877824:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 98us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403278.914805:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 210 00010000:00010000:1.0:1784403279.720294:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784403279.785484:0:10484:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:34:38 (1784403278) === 00000100:00100000:0.0:1784403280.227076:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403280.227199:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240878080 00000100:00100000:2.0:1784403280.227209:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240878080 00000100:00100000:2.0:1784403280.227269:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 211 00000100:00100000:2.0:1784403280.227279:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:8125:x1871082240878080:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784403280.227297:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403280.227339:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b2000/0x6828175665afa776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea17 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403280.227386:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b2000/0x6828175665afa776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea17 expref: 11 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403280.227399:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b2000/0x6828175665afa776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea17 expref: 11 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403280.227408:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2000, rc 0) 00000100:00100000:2.0:1784403280.227480:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:8125:x1871082240878080:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 202us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403280.227488:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 211 00000100:00100000:2.0:1784403280.241010:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403280.241080:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240878208 00000100:00100000:1.0:1784403280.241090:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240878208 00000100:00100000:1.0:1784403280.241150:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 212 00000100:00100000:1.0:1784403280.241161:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:8125:x1871082240878208:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784403280.243631:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:8125:x1871082240878208:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 2461us (2622us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403280.243644:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 212 00000100:00100000:1.0:1784403280.252094:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403280.252186:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240878336 00000100:00100000:3.0:1784403280.252197:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240878336 00000100:00100000:3.0:1784403280.252260:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 213 00000100:00100000:3.0:1784403280.252271:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:8125:x1871082240878336:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784403280.252608:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:8125:x1871082240878336:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 338us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403280.252624:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 213 00000100:00100000:0.0:1784403280.268915:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403280.269586:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240878464 00000100:00100000:1.0:1784403280.269597:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240878464 00000100:00100000:1.0:1784403280.269681:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 214 00000100:00100000:1.0:1784403280.269692:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:8129:x1871082240878464:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784403280.270119:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:8129:x1871082240878464:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 426us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403280.270128:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 214 00000100:00100000:0.0:1784403280.288971:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403280.289173:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240878592 00000100:00100000:2.0:1784403280.289186:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240878592 00000100:00100000:2.0:1784403280.289245:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 215 00000100:00100000:2.0:1784403280.289274:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:8129:x1871082240878592:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784403280.289591:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:8129:x1871082240878592:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 319us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403280.289599:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 215 00000100:00100000:0.0:1784403280.298816:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403280.298920:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240878720 00000100:00100000:1.0:1784403280.298932:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240878720 00000100:00100000:1.0:1784403280.298997:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 216 00000100:00100000:1.0:1784403280.299008:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:8125:x1871082240878720:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784403280.299026:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403280.299046:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a41671200/0x6828175665afa77d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea41 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403280.299079:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41671200/0x6828175665afa77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea41 expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403280.299091:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a41671200/0x6828175665afa77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea41 expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403280.299101:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a41671200, rc 0) 00000100:00100000:1.0:1784403280.299163:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:8125:x1871082240878720:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 157us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403280.299171:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 216 00000100:00100000:1.0:1784403280.307651:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403280.307863:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240878848 00000100:00100000:0.0:1784403280.307909:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240878848 00000100:00100000:0.0:1784403280.307972:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 217 00000100:00100000:0.0:1784403280.307982:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:8125:x1871082240878848:12345-192.168.204.28@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784403280.308010:0:6286:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784403280.308032:0:6286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784403280.308036:0:6286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784403280.308040:0:6286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784403280.308042:0:6286:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1784403280.315006:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:8125:x1871082240878848:12345-192.168.204.28@tcp:256:mount.lustre.0 Request processed in 7012us (7353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403280.315023:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 217 00000100:00100000:2.0:1784403280.329559:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403280.329782:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240878976 00000100:00100000:3.0:1784403280.329795:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240878976 00000100:00100000:3.0:1784403280.329862:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 218 00000100:00100000:3.0:1784403280.329897:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:8125:x1871082240878976:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784403280.329914:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403280.329945:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa784 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea48 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403280.329976:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea48 expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403280.329989:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea48 expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403280.329998:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:3.0:1784403280.330067:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:8125:x1871082240878976:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 172us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403280.330074:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 218 00000100:00100000:1.0:1784403280.335186:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403280.335328:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240879104 00000100:00100000:3.0:1784403280.335338:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240879104 00000100:00100000:3.0:1784403280.335397:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 219 00000100:00100000:3.0:1784403280.335408:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:8125:x1871082240879104:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784403280.336076:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:8125:x1871082240879104:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 666us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403280.336087:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 219 00000100:00100000:0.0:1784403280.339013:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403280.347692:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240879232 00000100:00100000:1.0:1784403280.347721:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240879232 00000100:00100000:1.0:1784403280.347898:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 220 00000100:00100000:1.0:1784403280.347909:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:8125:x1871082240879232:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784403280.348170:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:8125:x1871082240879232:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 262us (9168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403280.348179:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 220 00000100:00100000:0.0:1784403280.353741:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403280.358031:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240879360 00000100:00100000:2.0:1784403280.358051:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240879360 00000100:00100000:2.0:1784403280.358109:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 221 00000100:00100000:2.0:1784403280.358120:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:8132:x1871082240879360:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784403280.359159:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:8132:x1871082240879360:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 1035us (5424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403280.359171:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 221 00000100:00100000:0.0:1784403280.364984:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403280.365075:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240879488 00000100:00100000:1.0:1784403280.365086:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240879488 00000100:00100000:1.0:1784403280.365143:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 222 00000100:00100000:1.0:1784403280.365154:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:8132:x1871082240879488:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784403280.365827:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:8132:x1871082240879488:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 672us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403280.365837:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 222 00000100:00100000:0.0:1784403280.378743:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403280.378851:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240879616 00000100:00100000:2.0:1784403280.378897:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240879616 00000100:00100000:2.0:1784403280.378949:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:2.0:1784403280.378959:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2357:x1871082240879616:12345-192.168.204.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784403280.378995:0:10011:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from e673c1a5-a199-4481-8204-90c8d9cfec2f@192.168.204.28@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:2.0:1784403280.379041:0:10011:0:(genops.c:1385:class_connect()) connect: client e673c1a5-a199-4481-8204-90c8d9cfec2f, cookie 0x6828175665afa78b 00000004:00100000:2.0:1784403280.379078:0:10011:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784403280.379670:0:10011:0:(import.c:65:import_set_state_nolock()) ffff8c8a522c6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784403280.379763:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2357:x1871082240879616:12345-192.168.204.28@tcp:38:mount.lustre.0 Request processed in 802us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403280.379772:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:0.0:1784403280.385111:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403280.385198:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240880000 00000100:00100000:3.0:1784403280.385208:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240880000 00000100:00100000:3.0:1784403280.385293:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:3.0:1784403280.385306:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240880000:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403280.385389:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240880000:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403280.385397:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:0.0:1784403280.386281:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403280.386467:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240879872 00000100:00100000:3.0:1784403280.386475:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240879872 00000100:00100000:3.0:1784403280.386566:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:3.0:1784403280.386576:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:8125:x1871082240879872:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784403280.386615:0:6293:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784403280.386749:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:8125:x1871082240879872:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 174us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403280.386757:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1784403280.386899:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00080000:2.0:1784403280.386944:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403280.395357:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403280.397138:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240879744 00000100:00100000:1.0:1784403280.397152:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240879744 00000100:00100000:1.0:1784403280.397292:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1784403280.397303:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:0:x1871082240879744:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784403280.397337:0:10011:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784403280.397416:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:0:x1871082240879744:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 114us (10516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403280.397424:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1784403280.405782:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240880128 00000100:00100000:1.0:1784403280.405801:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240880128 00000100:00100000:1.0:1784403280.405882:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:1.0:1784403280.405893:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:8125:x1871082240880128:12345-192.168.204.28@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784403280.405994:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:8125:x1871082240880128:12345-192.168.204.28@tcp:40:mount.lustre.0 Request processed in 103us (10646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403280.406016:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:1.0:1784403280.408929:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403280.409080:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240880512 00000100:00100000:2.0:1784403280.409091:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240880512 00000100:00100000:2.0:1784403280.409145:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:2.0:1784403280.409155:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:8125:x1871082240880512:12345-192.168.204.28@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784403280.409779:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1784403280.409981:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:8125:x1871082240880512:12345-192.168.204.28@tcp:33:mount.lustre.0 Request processed in 826us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403280.409991:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:3.0:1784403280.410931:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403280.410966:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403280.411039:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240880256 00000100:00100000:0.0:1784403280.411049:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240880256 00000100:00100000:0.0:1784403280.411100:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240880384 00000100:00100000:0.0:1784403280.411104:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240880384 00000100:00100000:0.0:1784403280.411130:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:0.0:1784403280.411137:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1871082240880256:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784403280.411166:0:7099:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from e673c1a5-a199-4481-8204-90c8d9cfec2f@192.168.204.28@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:0.0:1784403280.411200:0:7099:0:(genops.c:1385:class_connect()) connect: client e673c1a5-a199-4481-8204-90c8d9cfec2f, cookie 0x6828175665afa792 00002000:00100000:0.0:1784403280.411213:0:7099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e673c1a5-a199-4481-8204-90c8d9cfec2f/ffff8c8a7ffde800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1784403280.411456:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:1.0:1784403280.411462:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1871082240880384:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784403280.411479:0:7102:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from e673c1a5-a199-4481-8204-90c8d9cfec2f@192.168.204.28@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:1.0:1784403280.411498:0:7102:0:(genops.c:1385:class_connect()) connect: client e673c1a5-a199-4481-8204-90c8d9cfec2f, cookie 0x6828175665afa799 00002000:00100000:1.0:1784403280.411503:0:7102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e673c1a5-a199-4481-8204-90c8d9cfec2f/ffff8c8a7b379000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784403280.411514:0:7102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784403280.411782:0:7102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784403280.411816:0:7102:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b37c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784403280.411908:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2357:x1871082240880384:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 443us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403280.411916:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00002000:00100000:0.0:1784403280.412141:0:7099:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784403280.412374:0:7099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784403280.412393:0:7099:0:(import.c:65:import_set_state_nolock()) ffff8c8a7ffdd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784403280.412441:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2357:x1871082240880256:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 1303us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403280.412449:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00010000:00010000:0.0:1784403280.738161:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403281.119227:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403281.119255:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260836992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403281.119330:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403281.119501:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260836992 00000100:00100000:3.0:1784403281.119521:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260836992 00000100:00100000:3.0:1784403281.119605:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784403281.119616:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260836992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784403281.119641:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403281.119707:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260836992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403281.119714:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1784403281.119757:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbca80 x1871082260836992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403281.119777:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260836992:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784403281.120240:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784403281.758955:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784403282.230319:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e673c1a5-a199-4481-8204-90c8d9cfec2f 00000001:00100000:3.0:1784403282.239712:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e673c1a5-a199-4481-8204-90c8d9cfec2f 00000001:00100000:2.0:1784403282.736685:0:6314:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e673c1a5-a199-4481-8204-90c8d9cfec2f 00010000:00010000:1.0:1784403282.783172:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403283.167837:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260837376:0@lo:400:kworker.0 00000100:00100000:3.0:1784403283.167937:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403283.168007:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784403283.168014:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260837504:0@lo:400:kworker.0 00000100:00100000:3.0:1784403283.168055:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403283.168106:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260837376 00000100:00100000:3.0:1784403283.168114:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260837376 00000100:00100000:3.0:1784403283.168171:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784403283.168181:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260837376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403283.168236:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260837376:12345-0@lo:400:kworker.0 Request processed in 56us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403283.168243:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784403283.168267:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260837504 00000100:00100000:3.0:1784403283.168271:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260837504 00000100:00100000:3.0:1784403283.168313:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784403283.168320:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260837504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403283.168355:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260837504:12345-0@lo:400:kworker.0 Request processed in 36us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403283.168362:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1784403283.168384:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784403283.168389:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784403283.168421:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd7800 x1871082260837504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403283.168437:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260837504:0@lo:400:kworker.0 00000100:00100000:3.0:1784403283.168450:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260837376:0@lo:400:kworker.0 00000100:00100000:2.0:1784403283.168641:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260837120:0@lo:400:kworker.0 00000100:00100000:2.0:1784403283.168690:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403283.168723:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260837632:0@lo:400:kworker.0 00000100:00100000:2.0:1784403283.168748:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403283.168768:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784403283.168774:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260837248:0@lo:400:kworker.0 00000100:00100000:2.0:1784403283.168796:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403283.168812:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260837760:0@lo:400:kworker.0 00000100:00100000:2.0:1784403283.168832:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403283.168857:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260837632 00000100:00100000:2.0:1784403283.168860:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260837632 00000100:00100000:2.0:1784403283.168906:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260837248 00000100:00100000:2.0:1784403283.168909:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260837248 00000100:00100000:2.0:1784403283.168924:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784403283.168930:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260837632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403283.168969:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260837632:12345-0@lo:400:kworker.0 Request processed in 38us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403283.168987:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784403283.169011:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784403283.169017:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260837248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403283.169049:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260837248:12345-0@lo:400:kworker.0 Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403283.169055:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784403283.169105:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260837248:0@lo:400:kworker.0 00000100:00100000:2.0:1784403283.169116:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260837632:0@lo:400:kworker.0 00000100:00100000:3.0:1784403283.169400:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260837120 00000100:00100000:3.0:1784403283.169404:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260837120 00000100:00100000:3.0:1784403283.169678:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784403283.169688:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260837120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403283.169735:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260837120:12345-0@lo:400:kworker.0 Request processed in 49us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403283.169743:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:3.0:1784403283.169777:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403283.169800:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260837120:0@lo:400:kworker.0 00000100:00100000:0.0:1784403283.169900:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260837760 00000100:00100000:0.0:1784403283.169906:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260837760 00000100:00100000:0.0:1784403283.169942:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784403283.169949:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260837760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403283.170007:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260837760:12345-0@lo:400:kworker.0 Request processed in 58us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403283.170014:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1784403283.170047:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd5880 x1871082260837760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403283.170059:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260837760:0@lo:400:kworker.0 00000100:00080000:3.0:1784403283.170278:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403283.685262:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784403283.685293:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260837888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403283.685382:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403283.685465:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260837888 00000100:00100000:3.0:1784403283.685484:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260837888 00000100:00100000:3.0:1784403283.685553:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784403283.685562:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260837888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403283.685611:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403283.685675:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260837888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403283.685683:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1784403283.685727:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7af41c00 x1871082260837888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403283.685747:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260837888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784403283.813752:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403284.831134:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403285.566061:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403285.566113:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403285.566158:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240880640 00000100:00100000:3.0:1784403285.566159:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403285.566170:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240880640 00000100:00100000:3.0:1784403285.566197:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403285.566230:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403285.566237:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 224 00000100:00100000:3.0:1784403285.566254:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240880896 00000100:00100000:3.0:1784403285.566260:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240880896 00000100:00100000:2.0:1784403285.566262:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240880640:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403285.566299:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240880768 00000100:00100000:3.0:1784403285.566303:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240880768 00000100:00100000:3.0:1784403285.566328:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:3.0:1784403285.566337:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2359:x1871082240880896:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403285.566357:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240880640:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403285.566366:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 224 00000100:00100000:3.0:1784403285.566377:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2359:x1871082240880896:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 39us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403285.566386:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:3.0:1784403285.566404:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:3.0:1784403285.566413:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2359:x1871082240880768:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403285.566441:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2359:x1871082240880768:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 29us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403285.566463:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:1.0:1784403285.566472:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240881152 00000100:00100000:1.0:1784403285.566478:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240881152 00000100:00100000:1.0:1784403285.566513:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240881024 00000100:00100000:1.0:1784403285.566516:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240881024 00000100:00100000:1.0:1784403285.566549:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:1.0:1784403285.566556:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2359:x1871082240881152:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403285.566586:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2359:x1871082240881152:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 30us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403285.566592:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:1.0:1784403285.566624:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:1.0:1784403285.566631:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a738ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2359:x1871082240881024:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403285.566658:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a738ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2359:x1871082240881024:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403285.566664:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00080000:2.0:1784403285.567079:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784403285.567084:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403285.567087:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784403285.855011:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403286.249454:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784403286.249480:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260838016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784403286.249553:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403286.249641:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260838016 00000100:00100000:1.0:1784403286.249650:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260838016 00000100:00100000:1.0:1784403286.249710:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784403286.249721:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260838016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784403286.249759:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403286.249806:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260838016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403286.249813:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1784403286.249835:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784403286.249883:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a42cbce00 x1871082260838016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403286.249904:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260838016:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1784403286.359363:0:10682:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1784403286.882712:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403287.908335:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403288.287208:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260838528:0@lo:400:kworker.0 00000100:00100000:3.0:1784403288.287411:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260838144:0@lo:400:kworker.0 00000100:00100000:1.0:1784403288.287520:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260838272:0@lo:400:kworker.0 00000100:00100000:2.0:1784403288.287765:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260838400:0@lo:400:kworker.0 00000100:00100000:3.0:1784403288.292735:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403288.292822:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260838656:0@lo:400:kworker.0 00000100:00100000:3.0:1784403288.292890:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403288.292948:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260838144 00000100:00100000:3.0:1784403288.292956:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260838144 00000100:00100000:3.0:1784403288.293006:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784403288.293017:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260838144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403288.293078:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260838144:12345-0@lo:400:kworker.0 Request processed in 62us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403288.293086:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784403288.293120:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260838656 00000100:00100000:3.0:1784403288.293123:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260838656 00000100:00100000:3.0:1784403288.293174:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784403288.293185:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260838656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403288.293218:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260838656:12345-0@lo:400:kworker.0 Request processed in 38us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403288.293224:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1784403288.293245:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403288.293624:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260838144:0@lo:400:kworker.0 00000100:00100000:3.0:1784403288.293639:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260838656:0@lo:400:kworker.0 00000100:00100000:0.0:1784403288.293756:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403288.293902:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403288.293954:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260838784:0@lo:400:kworker.0 00000100:00100000:1.0:1784403288.293981:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403288.294068:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260838272 00000100:00100000:0.0:1784403288.294073:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260838272 00000100:00100000:0.0:1784403288.294113:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784403288.294121:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260838272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403288.294163:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260838272:12345-0@lo:400:kworker.0 Request processed in 44us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403288.294170:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784403288.294200:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260838272:0@lo:400:kworker.0 00000100:00100000:3.0:1784403288.294459:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260838528 00000100:00100000:3.0:1784403288.294464:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260838528 00000100:00100000:3.0:1784403288.294626:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260838784 00000100:00100000:3.0:1784403288.294630:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260838784 00000100:00100000:3.0:1784403288.294655:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784403288.294663:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260838528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403288.294711:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260838528:12345-0@lo:400:kworker.0 Request processed in 50us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403288.294717:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784403288.294730:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784403288.294737:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260838784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403288.294771:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260838784:12345-0@lo:400:kworker.0 Request processed in 34us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403288.294776:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1784403288.294816:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1fb80 x1871082260838784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403288.294827:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260838784:0@lo:400:kworker.0 00000100:00100000:2.0:1784403288.298684:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403288.298750:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260838400 00000100:00100000:1.0:1784403288.298760:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260838400 00000100:00080000:0.0:1784403288.298886:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784403288.298892:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784403288.298896:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784403288.298939:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1df80 x1871082260838528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403288.298955:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260838528:0@lo:400:kworker.0 00000100:00100000:2.0:1784403288.299036:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784403288.299048:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260838400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403288.300053:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260838400:12345-0@lo:400:kworker.0 Request processed in 1001us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403288.300065:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784403288.300666:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260838400:0@lo:400:kworker.0 00000100:00100000:3.0:1784403288.799130:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784403288.799154:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260838912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403288.799226:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403288.799486:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260838912 00000100:00100000:3.0:1784403288.799494:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260838912 00000100:00100000:3.0:1784403288.799736:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784403288.799747:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260838912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403288.799856:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403288.800091:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260838912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 345us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403288.800100:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1784403288.806702:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7af42a00 x1871082260838912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403288.806731:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260838912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784403288.929927:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403289.953052:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403290.692836:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403290.692963:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403290.692999:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403290.693029:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403290.693075:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403290.693109:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240881536 00000100:00100000:1.0:1784403290.693118:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240881536 00000100:00100000:1.0:1784403290.693176:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240881408 00000100:00100000:1.0:1784403290.693179:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240881408 00000100:00100000:1.0:1784403290.693203:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:1.0:1784403290.693212:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240881536:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403290.693287:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240881536:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403290.693309:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:1.0:1784403290.693328:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:1.0:1784403290.693335:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240881408:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403290.693459:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240881792 00000100:00100000:3.0:1784403290.693464:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240881792 00000100:00100000:3.0:1784403290.693496:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240881664 00000100:00100000:3.0:1784403290.693499:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240881664 00000100:00100000:3.0:1784403290.693532:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:3.0:1784403290.693540:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240881792:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403290.693569:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240881792:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 30us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403290.693575:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:3.0:1784403290.693585:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:3.0:1784403290.693591:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240881664:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403290.693611:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240881664:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 20us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403290.693616:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00080000:3.0:1784403290.693675:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784403290.693680:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784403290.693683:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784403290.694238:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240881408:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403290.694265:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:2.0:1784403290.698567:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240881280 00000100:00100000:2.0:1784403290.698599:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240881280 00000100:00100000:2.0:1784403290.698679:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 226 00000100:00100000:2.0:1784403290.698691:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240881280:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403290.698790:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240881280:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 100us (5964us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403290.698798:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 226 00010000:00010000:1.0:1784403290.975200:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403291.362381:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403291.362412:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260839040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403291.362489:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403291.362894:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260839040 00000100:00100000:1.0:1784403291.362902:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260839040 00000100:00100000:1.0:1784403291.362975:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784403291.362984:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260839040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784403291.363020:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403291.363069:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260839040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403291.363077:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1784403291.363218:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48971500 x1871082260839040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403291.363237:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260839040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784403291.363897:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784403292.000218:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403293.024121:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403293.407735:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260839296:0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.407833:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403293.407927:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260839808:0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.407956:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403293.407987:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784403293.407994:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260839168:0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408024:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403293.408046:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260839680:0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408067:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403293.408093:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260839424:0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408116:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403293.408132:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403293.408138:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260839552:0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408169:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403293.408203:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260839296 00000100:00100000:2.0:1784403293.408209:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260839296 00000100:00100000:2.0:1784403293.408251:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260839680 00000100:00100000:2.0:1784403293.408254:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260839680 00000100:00100000:2.0:1784403293.408274:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260839424 00000100:00100000:2.0:1784403293.408277:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260839424 00000100:00100000:2.0:1784403293.408293:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784403293.408301:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260839296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408369:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260839296:12345-0@lo:400:kworker.0 Request processed in 67us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403293.408376:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784403293.408392:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784403293.408398:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260839680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408426:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260839680:12345-0@lo:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403293.408431:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784403293.408442:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784403293.408447:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260839424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408486:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260839424:12345-0@lo:400:kworker.0 Request processed in 39us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403293.408492:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784403293.408509:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260839808 00000100:00100000:2.0:1784403293.408513:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260839808 00000100:00100000:2.0:1784403293.408540:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260839552 00000100:00100000:2.0:1784403293.408542:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260839552 00000100:00100000:2.0:1784403293.408565:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784403293.408571:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260839808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408612:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260839808:12345-0@lo:400:kworker.0 Request processed in 41us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403293.408618:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784403293.408630:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784403293.408636:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260839552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408659:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260839552:12345-0@lo:400:kworker.0 Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403293.408665:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784403293.408683:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260839168 00000100:00100000:2.0:1784403293.408686:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260839168 00000100:00100000:2.0:1784403293.408710:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784403293.408716:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260839168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408745:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260839168:12345-0@lo:400:kworker.0 Request processed in 29us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403293.408751:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00080000:2.0:1784403293.408819:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1aa00 x1871082260839552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403293.408833:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260839552:0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408844:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260839424:0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408902:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260839168:0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408911:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260839680:0@lo:400:kworker.0 00000100:00100000:2.0:1784403293.408920:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260839296:0@lo:400:kworker.0 00010000:00080000:2.0:1784403293.408929:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a456bd500 x1871082260839808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403293.408944:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260839808:0@lo:400:kworker.0 00000100:00080000:0.0:1784403293.411044:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784403293.411055:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784403293.411058:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403293.919153:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784403293.919655:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260839936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784403293.919732:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403293.919943:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260839936 00000100:00100000:1.0:1784403293.919952:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260839936 00000100:00100000:1.0:1784403293.920010:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784403293.920026:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260839936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784403293.920068:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403293.920128:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260839936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403293.920139:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1784403293.920281:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7af42d80 x1871082260839936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403293.920302:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260839936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784403294.058100:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403295.071106:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403295.813640:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403295.813684:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403295.813720:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403295.813741:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403295.813763:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403295.813941:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240882048 00000100:00100000:2.0:1784403295.813953:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240882048 00000100:00100000:2.0:1784403295.814014:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240882176 00000100:00100000:2.0:1784403295.814017:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240882176 00000100:00100000:2.0:1784403295.814040:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:2.0:1784403295.814049:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240882048:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403295.814123:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240882048:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 75us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403295.814129:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:2.0:1784403295.814144:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:2.0:1784403295.814149:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240882176:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403295.814183:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240882176:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 34us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403295.814189:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:2.0:1784403295.814682:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240881920 00000100:00100000:2.0:1784403295.814689:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240881920 00000100:00100000:2.0:1784403295.814726:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 228 00000100:00100000:2.0:1784403295.814735:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240881920:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403295.814767:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240881920:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 34us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403295.814773:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 228 00000100:00100000:3.0:1784403295.817059:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240882304 00000100:00100000:3.0:1784403295.817071:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240882304 00000100:00100000:3.0:1784403295.817151:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240882432 00000100:00100000:3.0:1784403295.817154:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240882432 00000100:00100000:0.0:1784403295.817376:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:0.0:1784403295.817389:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240882304:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403295.817482:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240882304:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 95us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403295.817490:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00080000:0.0:1784403295.817519:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784403295.817525:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403295.818673:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:3.0:1784403295.818683:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240882432:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403295.818741:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240882432:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 59us (4976us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403295.818748:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00080000:0.0:1784403295.819088:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784403296.104234:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403296.479345:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260840064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403296.479436:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403296.479951:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260840064 00000100:00100000:1.0:1784403296.479961:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260840064 00000100:00100000:1.0:1784403296.480033:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784403296.480044:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260840064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784403296.480087:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403296.480139:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260840064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403296.480157:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1784403296.482081:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784403296.482150:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48973800 x1871082260840064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403296.482176:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260840064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784403297.121521:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403298.145761:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403298.527114:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260840192:0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.527490:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403298.527721:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260840448:0@lo:400:kworker.0 00000100:00100000:3.0:1784403298.527770:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403298.527791:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784403298.527797:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260840576:0@lo:400:kworker.0 00000100:00100000:3.0:1784403298.527820:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403298.527897:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260840192 00000100:00100000:2.0:1784403298.527906:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260840192 00000100:00100000:2.0:1784403298.527962:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1784403298.527973:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260840192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403298.528026:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260840192:12345-0@lo:400:kworker.0 Request processed in 54us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403298.528035:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1784403298.528078:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260840448 00000100:00100000:2.0:1784403298.528082:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260840448 00000100:00100000:2.0:1784403298.528119:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784403298.528127:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260840448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403298.528178:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260840448:12345-0@lo:400:kworker.0 Request processed in 52us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403298.528184:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1784403298.528200:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403298.528234:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260840448:0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.528417:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260840576 00000100:00100000:0.0:1784403298.528422:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260840576 00000100:00100000:0.0:1784403298.528457:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784403298.528464:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260840576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.528502:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260840576:12345-0@lo:400:kworker.0 Request processed in 38us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403298.528508:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784403298.528528:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260840320:0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.528554:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403298.528571:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260840832:0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.528592:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403298.528612:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784403298.528619:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260840704:0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.528640:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403298.528667:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260840832 00000100:00100000:0.0:1784403298.528681:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260840832 00000100:00100000:0.0:1784403298.528706:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784403298.528713:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260840832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.528748:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260840832:12345-0@lo:400:kworker.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403298.528754:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784403298.528771:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260840320 00000100:00100000:0.0:1784403298.528774:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260840320 00000100:00100000:0.0:1784403298.528792:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260840704 00000100:00100000:0.0:1784403298.528795:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260840704 00000100:00100000:0.0:1784403298.528811:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784403298.528817:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260840320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.528845:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260840320:12345-0@lo:400:kworker.0 Request processed in 29us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403298.528852:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784403298.528878:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784403298.528886:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260840704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.528913:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260840704:12345-0@lo:400:kworker.0 Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403298.528918:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784403298.528944:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260840192:0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.528966:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260840704:0@lo:400:kworker.0 00000100:00100000:0.0:1784403298.528975:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260840320:0@lo:400:kworker.0 00010000:00080000:0.0:1784403298.528987:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7af41880 x1871082260840832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403298.529009:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260840832:0@lo:400:kworker.0 00000100:00080000:2.0:1784403298.530266:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784403298.530274:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403298.530277:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784403298.530319:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7af40700 x1871082260840576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403298.530334:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260840576:0@lo:400:kworker.0 00000100:00100000:2.0:1784403299.051328:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260840960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784403299.051411:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403299.051624:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260840960 00000100:00100000:3.0:1784403299.051633:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260840960 00000100:00100000:3.0:1784403299.051688:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784403299.051697:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260840960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403299.051734:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403299.051786:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260840960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403299.051794:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1784403299.051835:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7af42680 x1871082260840960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403299.051859:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260840960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784403299.173308:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403300.191021:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403300.930089:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403300.930222:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403300.930251:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403300.930275:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403300.930299:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403300.930338:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240882816 00000100:00100000:2.0:1784403300.930348:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240882816 00000100:00100000:2.0:1784403300.930404:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240882688 00000100:00100000:2.0:1784403300.930407:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240882688 00000100:00100000:2.0:1784403300.930430:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:2.0:1784403300.930439:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240882816:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403300.930513:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240882816:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 74us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403300.930520:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:2.0:1784403300.930537:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:2.0:1784403300.930543:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240882688:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403300.930566:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240882688:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 24us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403300.930573:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:2.0:1784403300.930591:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240882944 00000100:00100000:2.0:1784403300.930594:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240882944 00000100:00100000:2.0:1784403300.930621:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240883072 00000100:00100000:2.0:1784403300.930624:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240883072 00000100:00100000:2.0:1784403300.930642:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1784403300.930647:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2357:x1871082240882944:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:2.0:1784403300.930675:0:7102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa792 00000100:00080000:2.0:1784403300.930683:0:7102:0:(import.c:65:import_set_state_nolock()) ffff8c8a7ffdd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784403300.930723:0:7102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784403300.931054:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+2:2357:x1871082240882944:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 405us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403300.931062:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1784403300.931074:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:2.0:1784403300.931080:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2357:x1871082240883072:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:2.0:1784403300.931091:0:7102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa799 00000100:00080000:2.0:1784403300.931096:0:7102:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b37c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784403300.931122:0:7102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784403300.931299:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+2:2357:x1871082240883072:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 219us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403300.931305:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00080000:2.0:1784403300.931337:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403300.931342:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784403300.931344:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784403300.931483:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403300.931490:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403300.938009:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240882560 00000100:00100000:1.0:1784403300.938027:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240882560 00000100:00100000:1.0:1784403300.938089:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 230 00000100:00100000:1.0:1784403300.938099:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240882560:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403300.938175:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240882560:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 78us (8097us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403300.938183:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 230 00010000:00010000:1.0:1784403301.214980:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403301.600100:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784403301.600124:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260841088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403301.600189:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403301.600273:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260841088 00000100:00100000:1.0:1784403301.600281:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260841088 00000100:00100000:1.0:1784403301.600357:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784403301.600367:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260841088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784403301.600405:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403301.600454:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260841088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403301.600461:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1784403301.600523:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784403301.600562:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48970a80 x1871082260841088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403301.600583:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260841088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784403302.241378:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784403302.707438:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e673c1a5-a199-4481-8204-90c8d9cfec2f 00000020:00000080:1.0:1784403302.707447:0:7124:0:(genops.c:885:class_export_put()) final put ffff8c8a7ffde800/e673c1a5-a199-4481-8204-90c8d9cfec2f 00000020:00000080:0.0:1784403302.707594:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7ffde800/e673c1a5-a199-4481-8204-90c8d9cfec2f for lustre-OST0000 00000001:00100000:1.0:1784403302.710069:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e673c1a5-a199-4481-8204-90c8d9cfec2f 00000020:00000080:1.0:1784403302.710136:0:8006:0:(genops.c:885:class_export_put()) final put ffff8c8a7b379000/e673c1a5-a199-4481-8204-90c8d9cfec2f 00000020:00000080:0.0:1784403302.711660:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a7ffdd800 for lustre-OST0000 00000020:00000080:1.0:1784403302.711800:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7b379000/e673c1a5-a199-4481-8204-90c8d9cfec2f for lustre-OST0001 00000020:00000080:1.0:1784403302.712010:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a7b37c800 for lustre-OST0001 00010000:00010000:2.0:1784403303.263124:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403303.648992:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260841600:0@lo:400:kworker.0 00000100:00100000:0.0:1784403303.649173:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260841216:0@lo:400:kworker.0 00000100:00100000:0.0:1784403303.649213:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403303.649262:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260841728:0@lo:400:kworker.0 00000100:00100000:0.0:1784403303.649302:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403303.649329:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784403303.649335:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260841344:0@lo:400:kworker.0 00000100:00100000:0.0:1784403303.649357:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403303.649373:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260841856:0@lo:400:kworker.0 00000100:00100000:0.0:1784403303.649393:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403303.649418:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260841472:0@lo:400:kworker.0 00000100:00100000:0.0:1784403303.649441:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403303.649474:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260841216 00000100:00100000:0.0:1784403303.649481:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260841216 00000100:00100000:0.0:1784403303.650227:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784403303.650240:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260841216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403303.650315:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260841216:12345-0@lo:400:kworker.0 Request processed in 78us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403303.650323:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784403303.650361:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260841728 00000100:00100000:0.0:1784403303.650366:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260841728 00000100:00100000:0.0:1784403303.650401:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260841344 00000100:00100000:0.0:1784403303.650405:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260841344 00000100:00100000:0.0:1784403303.650417:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260841472 00000100:00100000:0.0:1784403303.650421:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260841472 00000100:00100000:0.0:1784403303.650437:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784403303.650442:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260841728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403303.650476:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260841728:12345-0@lo:400:kworker.0 Request processed in 33us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403303.650482:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784403303.650506:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784403303.650513:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260841344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403303.651740:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784403303.651765:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260841472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403303.655189:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403303.655288:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260841856 00000100:00100000:2.0:1784403303.655298:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260841856 00000100:00100000:2.0:1784403303.655348:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260841600 00000100:00100000:2.0:1784403303.655351:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260841600 00000100:00100000:2.0:1784403303.655385:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784403303.655393:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260841856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403303.655468:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260841856:12345-0@lo:400:kworker.0 Request processed in 77us (6073us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403303.655476:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784403303.655492:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784403303.655498:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260841600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403303.655531:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260841600:12345-0@lo:400:kworker.0 Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403303.655537:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1784403303.655580:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1aa00 x1871082260841600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403303.655595:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260841600:0@lo:400:kworker.0 00000100:00080000:2.0:1784403303.655650:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784403303.655654:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403303.655657:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784403303.655681:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a52372300 x1871082260841856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403303.655691:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260841856:0@lo:400:kworker.0 00000100:00100000:2.0:1784403303.655703:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260841216:0@lo:400:kworker.0 00000100:00100000:2.0:1784403303.655715:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260841728:0@lo:400:kworker.0 00000100:00100000:1.0:1784403303.657432:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260841472:12345-0@lo:400:kworker.0 Request processed in 5664us (7980us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403303.657445:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784403303.657767:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260841472:0@lo:400:kworker.0 00000100:00100000:2.0:1784403303.660819:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260841344:0@lo:400:kworker.0 00000100:00100000:0.0:1784403303.660820:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260841344:12345-0@lo:400:kworker.0 Request processed in 10191us (11344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403303.660839:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000001:02000400:0.0:1784403303.866850:0:11384:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1784403304.159384:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260841984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403304.159460:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403304.159578:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260841984 00000100:00100000:2.0:1784403304.159587:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260841984 00000100:00100000:2.0:1784403304.159663:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784403304.159673:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260841984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403304.159715:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403304.164261:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260841984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4577us (4788us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403304.164287:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1784403304.164345:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7af42680 x1871082260841984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403304.164372:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260841984:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784403304.287937:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403305.314008:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403306.043469:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403306.043558:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403306.043585:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403306.051269:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240883200 00000100:00100000:3.0:1784403306.051287:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240883200 00000100:00100000:3.0:1784403306.051348:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 232 00000100:00100000:3.0:1784403306.051359:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240883200:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403306.051438:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240883200:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 81us (7879us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403306.051447:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 232 00000100:00100000:1.0:1784403306.051823:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240883328 00000100:00100000:1.0:1784403306.051828:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240883328 00000100:00100000:1.0:1784403306.051889:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240883456 00000100:00100000:1.0:1784403306.051892:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240883456 00000100:00100000:1.0:1784403306.051916:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:1.0:1784403306.051923:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240883328:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403306.051978:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240883328:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 55us (8520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403306.051985:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:1.0:1784403306.051998:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00100000:1.0:1784403306.052004:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240883456:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403306.052029:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240883456:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (8443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403306.052035:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00080000:0.0:1784403306.054498:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784403306.335171:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403306.720336:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260842112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784403306.720414:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403306.720693:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260842112 00000100:00100000:2.0:1784403306.720701:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260842112 00000100:00100000:2.0:1784403306.720768:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784403306.720777:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260842112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403306.720813:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1784403306.721053:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403306.721723:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260842112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 942us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403306.721733:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1784403306.722590:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a48973800 x1871082260842112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403306.722683:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a48973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260842112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784403307.370760:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784403307.773233:0:11531:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbaf65e40 20000000:00000080:2.0:1784403307.773254:0:11531:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c8a734be000 uarg=0000000000000000 20000000:01000000:2.0:1784403307.773299:0:11531:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784403307.773306:0:11531:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784403307.773312:0:11531:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784403307.777701:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1784403307.777942:0:11531:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784403307.789714:0:11531:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784403307.790055:0:11531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790079:0:11531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afa745 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea10 expref: 12 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790100:0:11531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa753 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa74c expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790108:0:11531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afa761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa75a expref: 18 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790114:0:11531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7b5b3200/0x6828175665afa76f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa768 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790122:0:11531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa784 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea48 expref: 12 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790130:0:11531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790175:0:11531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea48 expref: 12 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790192:0:11531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa784 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea48 expref: 12 pid: 6285 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403307.790219:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1871082260842240:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403307.790338:0:11531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7b5b3200/0x6828175665afa76f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa768 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790348:0:11531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a7b5b3200/0x6828175665afa76f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa768 expref: 18 pid: 6286 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403307.790357:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1871082260842368:0@lo:104: 00000100:00100000:0.0:1784403307.790406:0:11531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784403307.790450:0:11531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afa761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa75a expref: 18 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790458:0:11531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afa761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa75a expref: 18 pid: 6285 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403307.790467:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1871082260842496:0@lo:104: 00000100:00100000:0.0:1784403307.790489:0:11531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403307.790522:0:8872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260842368 00000100:00100000:0.0:1784403307.790529:0:8872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260842368 00000100:00100000:0.0:1784403307.790577:0:8872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260842496 00000100:00100000:0.0:1784403307.790580:0:8872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260842496 00000100:00100000:0.0:1784403307.790596:0:8872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784403307.790604:0:8872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:64472369-fee1-4bb4-a407-7797860a37a0+4:11531:x1871082260842368:12345-0@lo:104: 00010000:00010000:0.0:1784403307.790616:0:8872:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790662:0:8872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784403307.790668:0:8872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:64472369-fee1-4bb4-a407-7797860a37a0+4:11531:x1871082260842368:12345-0@lo:104: Request processed in 65us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403307.790675:0:8872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784403307.790696:0:8872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784403307.790703:0:8872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:64472369-fee1-4bb4-a407-7797860a37a0+3:11531:x1871082260842496:12345-0@lo:104: 00010000:00010000:0.0:1784403307.790712:0:8872:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790742:0:8872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784403307.790746:0:8872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:64472369-fee1-4bb4-a407-7797860a37a0+3:11531:x1871082260842496:12345-0@lo:104: Request processed in 45us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403307.790758:0:8872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1784403307.790789:0:11531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa74c expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790797:0:11531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa753 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa74c expref: 18 pid: 6286 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403307.790806:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1871082260842624:0@lo:104: 00000100:00100000:0.0:1784403307.790831:0:11531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403307.790850:0:8872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260842624 00000100:00100000:0.0:1784403307.790853:0:8872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260842624 00000100:00100000:0.0:1784403307.790913:0:8872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784403307.790919:0:8872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:64472369-fee1-4bb4-a407-7797860a37a0+3:11531:x1871082260842624:12345-0@lo:104: 00010000:00010000:0.0:1784403307.790927:0:8872:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790959:0:8872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784403307.790964:0:8872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:64472369-fee1-4bb4-a407-7797860a37a0+3:11531:x1871082260842624:12345-0@lo:104: Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403307.790970:0:8872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1784403307.790984:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784403307.790989:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.790996:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3e00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:0.0:1784403307.791000:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791009:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784403307.791022:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403307.791027:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784403307.791070:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791077:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784403307.791095:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791102:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3e00/0x6828175665afa768 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa76f expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791114:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784403307.791117:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791122:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2e00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:0.0:1784403307.791125:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791132:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784403307.791138:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403307.791142:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784403307.791163:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791169:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784403307.791177:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791183:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2e00/0x6828175665afa75a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa761 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791192:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403307.791195:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791211:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:0.0:1784403307.791214:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791221:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784403307.791227:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403307.791232:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784403307.791245:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791251:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784403307.791263:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791278:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa74c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa753 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791290:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403307.791292:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403307.791294:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403307.791323:0:11531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afa745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea10 expref: 12 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.791331:0:11531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afa745 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea10 expref: 12 pid: 6285 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403307.791340:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1871082260843136:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403307.791378:0:11531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784403307.791402:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1871082260842368:0@lo:104: 00000100:00100000:0.0:1784403307.791413:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1871082260842496:0@lo:104: 00000100:00100000:0.0:1784403307.791419:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1871082260842624:0@lo:104: 00000100:00100000:1.0:1784403307.791630:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260843008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403307.791666:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403307.792034:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260842880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784403307.792069:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403307.792104:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784403307.792110:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260842752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784403307.792130:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403307.792160:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260843008 00000100:00100000:3.0:1784403307.792172:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260843008 00010000:00010000:3.0:1784403307.792206:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa753 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa74c expref: 19 pid: 6286 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403307.792234:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260842880 00000100:00100000:3.0:1784403307.792238:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260842880 00010000:00010000:3.0:1784403307.792249:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afa761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa75a expref: 20 pid: 6285 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403307.792260:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260842752 00000100:00100000:3.0:1784403307.792262:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260842752 00010000:00010000:3.0:1784403307.792272:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7b5b3200/0x6828175665afa76f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa768 expref: 21 pid: 6286 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403307.792283:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784403307.792290:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+21:3567:x1871082260843008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403307.792302:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403307.792308:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa753 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa74c expref: 21 pid: 6286 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403307.792318:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa74c expref: 21 pid: 6286 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403307.792333:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa753 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa74c expref: 21 pid: 6286 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403307.792347:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403307.792382:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+20:3567:x1871082260843008:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403307.792389:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784403307.792430:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784403307.792441:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260842880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403307.792449:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403307.792454:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afa761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa75a expref: 19 pid: 6285 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403307.792462:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afa761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa75a expref: 19 pid: 6285 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403307.792471:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afa761 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa75a expref: 19 pid: 6285 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403307.792480:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403307.792506:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+18:3566:x1871082260842880:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403307.792513:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784403307.792526:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784403307.792532:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+17:3566:x1871082260842752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403307.792539:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403307.792543:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7b5b3200/0x6828175665afa76f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa768 expref: 17 pid: 6286 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403307.792551:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7b5b3200/0x6828175665afa76f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa768 expref: 17 pid: 6286 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403307.792561:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7b5b3200/0x6828175665afa76f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa768 expref: 17 pid: 6286 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403307.792570:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403307.792591:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+16:3566:x1871082260842752:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403307.792604:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784403307.792636:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260843008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784403307.792663:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260842752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784403307.792670:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260842880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784403307.793298:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403307.793306:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403307.794508:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1871082260842240:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403307.794520:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1871082260843136:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403307.794555:0:11531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403307.795341:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403307.795460:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403307.798195:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240883584 00000100:00100000:3.0:1784403307.798219:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240883584 00010000:00010000:3.0:1784403307.798271:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa784 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea48 expref: 13 pid: 6285 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403307.799080:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240883712 00000100:00100000:3.0:1784403307.799089:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240883712 00010000:00010000:3.0:1784403307.799113:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afa745 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea10 expref: 14 pid: 6285 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403307.799187:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:2.0:1784403307.799209:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48971500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+14:2360:x1871082240883584:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403307.799230:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403307.799254:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa784 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea48 expref: 14 pid: 6285 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799266:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea48 expref: 14 pid: 6285 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799302:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa784 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea48 expref: 14 pid: 6285 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799319:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403307.799379:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48971500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240883584:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 183us (4041us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403307.799387:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:2.0:1784403307.799406:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:2.0:1784403307.799412:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:2360:x1871082240883712:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403307.799422:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403307.799426:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afa745 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea10 expref: 12 pid: 6285 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799434:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afa745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea10 expref: 12 pid: 6285 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799443:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afa745 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea10 expref: 12 pid: 6285 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799455:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799465:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799491:0:6277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799497:0:6277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799503:0:6277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799509:0:6277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799515:0:6277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4000 already unused, calling callback (ffffffffc149a230) 00010000:00010000:2.0:1784403307.799520:0:6277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799528:0:6277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799545:0:6277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403307.799557:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403307.799579:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:2360:x1871082240883712:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 167us (4120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403307.799586:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00010000:00010000:0.0:1784403307.803084:0:11531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.803103:0:11531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403307.803131:0:11531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce4000/0x6828175665afa7a0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403308.383119:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403308.768355:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260843392:0@lo:400:kworker.0 00000100:00100000:2.0:1784403308.768386:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260843264:0@lo:400:kworker.0 00000100:00100000:0.0:1784403308.768438:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403308.768440:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403308.768504:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260843904:0@lo:400:kworker.0 00000100:00100000:0.0:1784403308.768531:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403308.768560:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784403308.768568:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260843520:0@lo:400:kworker.0 00000100:00100000:0.0:1784403308.768593:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403308.768623:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260843392 00000100:00100000:0.0:1784403308.768630:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260843392 00000100:00100000:2.0:1784403308.768664:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260843776:0@lo:400:kworker.0 00000100:00100000:0.0:1784403308.768681:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260843520 00000100:00100000:0.0:1784403308.768685:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260843520 00000100:00100000:2.0:1784403308.768711:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403308.769948:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260843264 00000100:00100000:3.0:1784403308.770688:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260843264 00000100:00100000:3.0:1784403308.770757:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1784403308.770768:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:3568:x1871082260843264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403308.770851:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+16:3568:x1871082260843264:12345-0@lo:400:kworker.0 Request processed in 85us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403308.770860:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1784403308.770942:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260843648:0@lo:400:kworker.0 00000100:00100000:0.0:1784403308.772400:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260843776 00000100:00100000:0.0:1784403308.772412:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260843776 00000100:00100000:0.0:1784403308.772464:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784403308.772473:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260843392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403308.775334:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260843264:0@lo:400:kworker.0 00000100:00100000:2.0:1784403308.775457:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784403308.775477:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260843520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403308.775616:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403308.775652:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260843520:12345-0@lo:400:kworker.0 Request processed in 112us (6986us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403308.775661:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784403308.775679:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260843904 00000100:00100000:2.0:1784403308.775684:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784403308.775686:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260843904 00000100:00100000:2.0:1784403308.775691:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260843776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403308.775724:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260843648 00000100:00100000:2.0:1784403308.775726:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260843776:12345-0@lo:400:kworker.0 Request processed in 36us (7017us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403308.775732:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784403308.775739:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260843648 00000100:00100000:3.0:1784403308.775763:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784403308.775771:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260843904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403308.775771:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260843776:0@lo:400:kworker.0 00000100:00100000:3.0:1784403308.775807:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260843904:12345-0@lo:400:kworker.0 Request processed in 38us (7275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403308.775813:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784403308.775826:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784403308.775832:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260843648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403308.775861:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260843648:12345-0@lo:400:kworker.0 Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403308.775884:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1784403308.775916:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a52372d80 x1871082260843648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403308.775926:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260843648:0@lo:400:kworker.0 00000100:00080000:3.0:1784403308.775979:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784403308.775983:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784403308.775986:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403308.776037:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260843520:0@lo:400:kworker.0 00010000:00080000:3.0:1784403308.776048:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a52373b80 x1871082260843904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403308.776057:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260843904:0@lo:400:kworker.0 00000100:00100000:0.0:1784403308.782070:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260843392:12345-0@lo:400:kworker.0 Request processed in 9588us (13626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403308.782087:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784403308.782133:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260843392:0@lo:400:kworker.0 00000100:00100000:3.0:1784403308.986638:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403308.986767:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240883840 00000100:00100000:1.0:1784403308.986779:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240883840 00000100:00100000:1.0:1784403308.986844:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 234 00000100:00100000:1.0:1784403308.986856:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:5576:x1871082240883840:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403308.986893:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403308.986914:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a41670400/0x6828175665afa7a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea72 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403308.986945:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41670400/0x6828175665afa7a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea72 expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403308.986957:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a41670400/0x6828175665afa7a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea72 expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403308.986967:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a41670400, rc 0) 00000100:00100000:1.0:1784403308.987077:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:5576:x1871082240883840:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 223us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403308.987085:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 234 00000100:00100000:1.0:1784403309.004676:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403309.004719:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240883968 00000100:00100000:3.0:1784403309.004730:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240883968 00000100:00100000:3.0:1784403309.004788:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 235 00000100:00100000:3.0:1784403309.004799:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:5576:x1871082240883968:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403309.005251:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:5576:x1871082240883968:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 453us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403309.005260:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 235 00000100:00100000:3.0:1784403309.020396:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403309.022497:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240884096 00000100:00100000:1.0:1784403309.022509:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240884096 00000100:00100000:1.0:1784403309.022575:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 236 00000100:00100000:1.0:1784403309.022585:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:5576:x1871082240884096:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784403309.022840:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:5576:x1871082240884096:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 255us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403309.022855:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 236 00000100:00100000:1.0:1784403309.027959:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403309.028599:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240884224 00000100:00100000:3.0:1784403309.028623:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240884224 00000100:00100000:3.0:1784403309.028688:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 237 00000100:00100000:3.0:1784403309.028698:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:5576:x1871082240884224:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403309.028717:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403309.028739:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afa7ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea79 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.028844:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afa7ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea79 expref: 13 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.028862:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afa7ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea79 expref: 13 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.028912:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7e00, rc 0) 00000100:00100000:3.0:1784403309.028980:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240884224:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 283us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403309.028987:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 237 00000100:00100000:1.0:1784403309.031474:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403309.036014:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240884352 00000100:00100000:2.0:1784403309.036028:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240884352 00000100:00100000:3.0:1784403309.036087:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 238 00000100:00100000:3.0:1784403309.036101:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240884352:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403309.036449:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240884352:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 350us (4991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403309.042025:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 238 00000100:00100000:3.0:1784403309.043680:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403309.047411:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240884480 00000100:00100000:2.0:1784403309.047426:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240884480 00000100:00100000:2.0:1784403309.047495:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 239 00000100:00100000:2.0:1784403309.047505:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240884480:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403309.047739:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240884480:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 234us (4064us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403309.047747:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 239 00000100:00100000:0.0:1784403309.279167:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260844032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784403309.279257:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403309.279576:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260844032 00000100:00100000:2.0:1784403309.279585:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260844032 00000100:00100000:2.0:1784403309.279640:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784403309.279665:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260844032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403309.279704:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403309.279756:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260844032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403309.279764:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1784403309.279911:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7af40380 x1871082260844032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403309.279931:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260844032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784403309.407580:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784403309.663010:0:6290:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784403309.663020:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a42cc6000 from 7 10000000:01000000:2.0:1784403309.663026:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784403309.663078:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403309.663090:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403309.663102:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403309.663131:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52371500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784403309.663220:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403309.664358:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45610a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784403309.669839:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260844160 00000100:00100000:3.0:1784403309.669857:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260844160 00000100:00100000:3.0:1784403309.670097:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1784403309.670108:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260844160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403309.670127:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403309.670147:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa7bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa7b5 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.670186:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa7bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa7b5 expref: 17 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.670197:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa7bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa7b5 expref: 17 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.670206:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7200, rc 0) 00000100:00100000:3.0:1784403309.670306:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260844160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (7085us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403309.670313:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1784403309.670473:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52371500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403309.670495:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403309.670517:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403309.670591:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403309.670628:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403309.676414:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac540 going to sleep for 11 seconds 00000100:00100000:2.0:1784403309.679641:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260844288 00000100:00100000:2.0:1784403309.679654:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260844288 00000100:00100000:2.0:1784403309.679724:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1784403309.679735:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260844288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403309.681580:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260844288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1841us (10945us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403309.681595:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784403309.687195:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403309.687271:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403309.687352:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403309.687459:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac540 going to sleep for 11 seconds 00000100:00100000:2.0:1784403309.691113:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260844416 00000100:00100000:2.0:1784403309.691143:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260844416 00000100:00100000:2.0:1784403309.692832:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784403309.692854:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260844416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403309.693153:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260844416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 307us (5800us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403309.693172:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784403309.693310:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784403309.694023:0:11589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784403309.694081:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784403309.694100:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784403309.694111:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403309.694121:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403309.694132:0:6290:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784403309.694135:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a43036800 from 7 10000000:01000000:0.0:1784403309.694138:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784403309.694185:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403309.694208:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403309.694220:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403309.694245:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784403309.694298:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403309.697761:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784403309.699144:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260844544 00000100:00100000:3.0:1784403309.699158:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260844544 00000100:00100000:3.0:1784403309.699233:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784403309.699249:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260844544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403309.699266:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403309.699284:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce7000/0x6828175665afa7ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa7c3 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.699313:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce7000/0x6828175665afa7ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa7c3 expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.699325:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce7000/0x6828175665afa7ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa7c3 expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.699334:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7000, rc 0) 00000100:00100000:3.0:1784403309.700328:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260844544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1074us (6024us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403309.703624:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784403309.703734:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403309.703764:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.703778:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403309.703863:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403309.703936:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403309.704682:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1784403309.704686:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260844672 00000100:00100000:0.0:1784403309.704694:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260844672 00000100:00100000:0.0:1784403309.704744:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1784403309.704755:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260844672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403309.705060:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260844672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403309.705068:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1784403309.706726:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403309.706794:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403309.706891:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403309.707037:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ad840 going to sleep for 11 seconds 00000100:00100000:2.0:1784403309.711053:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260844800 00000100:00100000:2.0:1784403309.711071:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260844800 00000100:00100000:2.0:1784403309.711199:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1784403309.711211:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260844800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403309.712340:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260844800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1128us (5445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403309.712352:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1784403309.712474:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784403309.717499:0:11590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784403309.717830:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784403309.717859:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784403309.717894:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403309.717910:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403309.717922:0:6290:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784403309.717925:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a5270b000 from 7 10000000:01000000:0.0:1784403309.717928:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784403309.717976:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403309.717997:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403309.718134:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403309.718175:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784403309.718250:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403309.718296:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736acb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784403309.718544:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260844928 00000100:00100000:3.0:1784403309.718553:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260844928 00000100:00100000:3.0:1784403309.718847:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1784403309.718858:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260844928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403309.718890:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403309.718906:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa7d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa7d1 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.718935:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa7d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa7d1 expref: 19 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.719076:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa7d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa7d1 expref: 19 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403309.719086:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:3.0:1784403309.719138:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260844928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 282us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403309.719146:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1784403309.719548:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260844928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403309.719581:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403309.719592:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403309.719657:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260845056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403309.719817:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403309.719858:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784403309.719895:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260845056 00000100:00100000:0.0:1784403309.719901:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260845056 00000100:00100000:0.0:1784403309.719928:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1784403309.719938:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260845056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403309.720300:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260845056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 363us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403309.720308:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1784403309.720357:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260845056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403309.720390:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260845184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403309.722844:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403309.723018:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736acb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784403309.728049:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260845184 00000100:00100000:2.0:1784403309.728065:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260845184 00000100:00100000:3.0:1784403309.730721:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1784403309.730736:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260845184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403309.731027:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260845184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 294us (8188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403309.731034:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1784403309.731149:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260845184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784403309.734294:0:11591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784403309.734364:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784403309.734381:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784403309.734394:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403309.734406:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403310.431551:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403311.170181:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403311.170227:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403311.170384:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240884608 00000100:00100000:3.0:1784403311.170394:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240884608 00000100:00100000:3.0:1784403311.170449:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 249 00000100:00100000:3.0:1784403311.170460:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240884608:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403311.170535:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240884608:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 76us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403311.170544:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 249 00000100:00100000:0.0:1784403311.175561:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240884736 00000100:00100000:0.0:1784403311.175578:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240884736 00000100:00100000:0.0:1784403311.176112:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:0.0:1784403311.176126:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240884736:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403311.176222:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240884736:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 100us (5993us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403311.176229:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:0.0:1784403311.176354:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403311.176462:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240884864 00000100:00100000:0.0:1784403311.176467:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240884864 00000100:00080000:2.0:1784403311.182386:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403311.182584:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 96 00000100:00100000:0.0:1784403311.182600:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240884864:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403311.182698:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240884864:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 102us (6343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403311.182707:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 96 00010000:00010000:2.0:1784403311.455162:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403311.839940:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784403311.839962:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7fec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260845312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784403311.840031:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403311.840108:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260845312 00000100:00100000:1.0:1784403311.840117:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260845312 00000100:00100000:1.0:1784403311.840193:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784403311.840204:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260845312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784403311.840243:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403311.840288:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260845312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403311.840295:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1784403311.840315:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784403311.840347:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7fec7100 x1871082260845312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403311.840367:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7fec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260845312:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1784403312.463829:0:11730:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784403312.479232:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403313.503513:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403313.887380:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260845568:0@lo:400:kworker.0 00000100:00100000:2.0:1784403313.887449:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403313.887495:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260846080:0@lo:400:kworker.0 00000100:00100000:2.0:1784403313.887516:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403313.887546:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784403313.887565:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260845696:0@lo:400:kworker.0 00000100:00100000:2.0:1784403313.887589:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403313.887637:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260845568 00000100:00100000:2.0:1784403313.887644:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260845568 00000100:00100000:2.0:1784403313.887693:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260845696 00000100:00100000:2.0:1784403313.887696:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260845696 00000100:00100000:2.0:1784403313.887727:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784403313.887736:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260845568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403313.887791:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260845568:12345-0@lo:400:kworker.0 Request processed in 55us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403313.887798:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784403313.887816:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784403313.887822:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260845696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403313.887849:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260845696:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403313.887855:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784403313.887896:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260846080 00000100:00100000:2.0:1784403313.887899:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260846080 00000100:00100000:2.0:1784403313.887927:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784403313.887933:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260846080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403313.887959:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260846080:12345-0@lo:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403313.887964:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1784403313.887984:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403313.887988:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403313.888024:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260845696:0@lo:400:kworker.0 00000100:00100000:2.0:1784403313.888035:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260845568:0@lo:400:kworker.0 00010000:00080000:2.0:1784403313.888057:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a52371880 x1871082260846080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403313.888069:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260846080:0@lo:400:kworker.0 00000100:00100000:1.0:1784403313.888599:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260845440:0@lo:400:kworker.0 00000100:00100000:1.0:1784403313.888696:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403313.888734:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260845952:0@lo:400:kworker.0 00000100:00100000:1.0:1784403313.888759:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403313.888781:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784403313.888787:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260845824:0@lo:400:kworker.0 00000100:00100000:1.0:1784403313.888809:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403313.889289:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260845440 00000100:00100000:2.0:1784403313.889296:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260845440 00000100:00100000:2.0:1784403313.889405:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1784403313.889413:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260845440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403313.892456:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260845952 00000100:00100000:0.0:1784403313.892473:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260845952 00000100:00100000:0.0:1784403313.892550:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784403313.892561:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260845952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403313.892969:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260845440:12345-0@lo:400:kworker.0 Request processed in 3555us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403313.892980:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:2.0:1784403313.893012:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403313.895799:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260845952:12345-0@lo:400:kworker.0 Request processed in 3227us (7025us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403313.895815:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784403313.895941:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260845440:0@lo:400:kworker.0 00000100:00100000:0.0:1784403313.895961:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260845952:0@lo:400:kworker.0 00000100:00100000:1.0:1784403313.896343:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260845824 00000100:00100000:1.0:1784403313.896351:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260845824 00000100:00100000:1.0:1784403313.896467:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784403313.896478:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260845824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403313.896554:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260845824:12345-0@lo:400:kworker.0 Request processed in 79us (7743us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403313.896561:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1784403313.896601:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784403313.901385:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a52370700 x1871082260845824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403313.901406:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260845824:0@lo:400:kworker.0 00000100:00100000:3.0:1784403314.400101:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260846208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403314.400182:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403314.400689:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260846208 00000100:00100000:2.0:1784403314.400698:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260846208 00000100:00100000:2.0:1784403314.400761:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784403314.400772:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260846208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403314.400812:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403314.400905:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260846208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403314.400912:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1784403314.401312:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a52370700 x1871082260846208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403314.401336:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260846208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784403314.529153:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403315.551293:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403316.284577:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403316.284631:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403316.284672:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403316.284702:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240885248 00000100:00100000:0.0:1784403316.284711:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240885248 00000100:00100000:0.0:1784403316.284764:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240885120 00000100:00100000:0.0:1784403316.284768:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240885120 00000100:00100000:0.0:1784403316.284794:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 100 00000100:00100000:0.0:1784403316.284804:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2358:x1871082240885248:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403316.284920:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2358:x1871082240885248:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 116us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403316.284928:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 100 00000100:00100000:0.0:1784403316.284954:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00100000:0.0:1784403316.284960:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240885120:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403316.284987:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240885120:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403316.284992:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00080000:3.0:1784403316.285486:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403316.287392:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240884992 00000100:00100000:2.0:1784403316.287407:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240884992 00000100:00100000:2.0:1784403316.287471:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 251 00000100:00100000:2.0:1784403316.287481:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2358:x1871082240884992:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403316.287560:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2358:x1871082240884992:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 80us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403316.287568:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 251 00000001:02000400:1.0:1784403316.391662:0:11831:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:35:15 (1784403315) === 00010000:00010000:3.0:1784403316.575005:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403316.717972:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403316.718067:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240885376 00000100:00100000:1.0:1784403316.718069:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403316.718077:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240885376 00000100:00100000:2.0:1784403316.718143:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1784403316.718155:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240885376:12345-192.168.204.28@tcp:41:mkdir.0 00000100:00100000:3.0:1784403316.718162:0:6301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240885504 00000100:00100000:3.0:1784403316.718166:0:6301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240885504 00000004:00000024:2.0:1784403316.718202:0:6292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784403316.718295:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240885376:12345-192.168.204.28@tcp:41:mkdir.0 Request processed in 142us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403316.718303:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:3.0:1784403316.725508:0:6301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:3.0:1784403316.725529:0:6301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:9674:x1871082240885504:12345-192.168.204.28@tcp:700:mkdir.0 00000100:00100000:3.0:1784403316.725654:0:6301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:9674:x1871082240885504:12345-192.168.204.28@tcp:700:mkdir.0 Request processed in 132us (7584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403316.725662:0:6301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:1.0:1784403316.729558:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403316.730715:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240885760 00000100:00100000:0.0:1784403316.730726:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240885760 00000100:00100000:1.0:1784403316.730825:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:1.0:1784403316.730836:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:9674:x1871082240885760:12345-192.168.204.28@tcp:36:mkdir.0 00010000:00010000:1.0:1784403316.730907:0:10011:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403316.730936:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afa6c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9fb expref: 6 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.730958:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:1.0:1784403316.730969:0:10011:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784403316.731314:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41670800/0x6828175665afa7df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.731328:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41670800/0x6828175665afa7df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.731337:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41670800/0x6828175665afa7df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.731385:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.731403:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.731410:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403316.733331:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784403316.733349:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41670800/0x6828175665afa7df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.733358:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41670800/0x6828175665afa7df lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.733364:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41670800/0x6828175665afa7df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.733370:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a41670800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403316.733375:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41670800/0x6828175665afa7df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.733382:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41670800/0x6828175665afa7df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.733399:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:1.0:1784403316.733403:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403316.733408:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41670800/0x6828175665afa7df lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403316.733414:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41670800/0x6828175665afa7df lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784403316.733447:0:10011:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d2131ae reply state 000000002946b99c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403316.733456:0:10011:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784403316.734061:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:9674:x1871082240885760:12345-192.168.204.28@tcp:36:mkdir.0 Request processed in 3220us (4507us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784403316.734072:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00010000:00010000:0.0:1784403316.748622:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.748642:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.748649:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.748655:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a41671000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403316.748660:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.748667:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.748685:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c8a51bd0700) 00010000:00010000:0.0:1784403316.748688:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403316.748693:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.748699:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa7e6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403316.789665:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403316.789771:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240885888 00000100:00100000:0.0:1784403316.789781:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240885888 00000100:00100000:0.0:1784403316.789852:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1784403316.789862:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:9678:x1871082240885888:12345-192.168.204.28@tcp:101:chmod.0 00010000:00010000:0.0:1784403316.789919:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403316.789955:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa7ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea80 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.790040:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa7f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.790054:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.790065:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403316.790126:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1784403316.790130:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403316.790173:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.790199:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa7ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea80 expref: 8 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.790216:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea80 expref: 7 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.790224:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:0.0:1784403316.790240:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403316.790244:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4c00, rc 0) 00000100:00100000:0.0:1784403316.790396:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:9678:x1871082240885888:12345-192.168.204.28@tcp:101:chmod.0 Request processed in 535us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403316.790403:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:2.0:1784403316.808428:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403316.808575:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240886144 00000100:00100000:3.0:1784403316.808598:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240886144 00000100:00100000:3.0:1784403316.808660:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:3.0:1784403316.808670:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:9678:x1871082240886144:12345-192.168.204.28@tcp:36:chmod.0 00010000:00010000:3.0:1784403316.808726:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403316.808756:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa7f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea80 expref: 7 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.808779:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:3.0:1784403316.808790:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784403316.808828:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.808849:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.808860:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403316.809994:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026b70e48 reply state 000000006fde73d7 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403316.810007:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784403316.810022:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1784403316.810133:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:9678:x1871082240886144:12345-192.168.204.28@tcp:36:chmod.0 Request processed in 1461us (1712us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784403316.810142:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00010000:00010000:3.0:1784403316.812385:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.812403:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.812411:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.812417:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403316.812422:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.812444:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.812477:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a43245200) 00010000:00010000:3.0:1784403316.812481:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784403316.812486:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.812493:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa7fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403316.830332:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403316.830425:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240886272 00000100:00100000:0.0:1784403316.830435:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240886272 00000100:00100000:0.0:1784403316.830514:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:0.0:1784403316.830525:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:9679:x1871082240886272:12345-192.168.204.28@tcp:101:chown.0 00010000:00010000:0.0:1784403316.830556:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403316.830601:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea87 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.830681:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa809 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.830696:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.830708:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403316.830780:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1784403316.830784:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403316.830834:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.830862:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea87 expref: 9 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.830942:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea87 expref: 8 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.830952:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884df00) 00010000:00010000:0.0:1784403316.830956:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403316.830960:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4c00, rc 0) 00000100:00100000:0.0:1784403316.831026:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:9679:x1871082240886272:12345-192.168.204.28@tcp:101:chown.0 Request processed in 502us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403316.831044:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:1.0:1784403316.835853:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403316.836043:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240886400 00000100:00100000:2.0:1784403316.836057:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240886400 00000100:00100000:2.0:1784403316.836115:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1784403316.836125:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:9679:x1871082240886400:12345-192.168.204.28@tcp:101:chown.0 00010000:00010000:2.0:1784403316.836143:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403316.836175:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea8e expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836234:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa817 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836257:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836268:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836282:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa81e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836289:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa81e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836295:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa81e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836395:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836403:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836409:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403316.836444:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784403316.836447:0:6294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403316.836481:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836498:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836505:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa817 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.836857:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837119:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403316.837124:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837134:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa817 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837148:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884df00) 00010000:00010000:2.0:1784403316.837151:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403316.837155:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa817 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837162:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa817 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837176:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa81e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837209:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa81e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837216:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa81e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837228:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403316.837232:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa81e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837238:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa81e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837327:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c8a49e8ca00) 00010000:00010000:2.0:1784403316.837330:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403316.837333:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa81e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837339:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa81e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837426:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea8e expref: 10 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837505:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea8e expref: 9 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.837514:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a49e8c400) 00010000:00010000:2.0:1784403316.837516:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784403316.837518:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2a00, rc 0) 00000100:00100000:2.0:1784403316.837581:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:9679:x1871082240886400:12345-192.168.204.28@tcp:101:chown.0 Request processed in 1458us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403316.837589:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:3.0:1784403316.842745:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403316.845065:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240886656 00000100:00100000:0.0:1784403316.845083:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240886656 00000100:00100000:0.0:1784403316.845159:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:0.0:1784403316.845170:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:9679:x1871082240886656:12345-192.168.204.28@tcp:36:chown.0 00010000:00010000:0.0:1784403316.845225:0:6293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403316.845254:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea8e expref: 9 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.845275:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a49e8c400) 00010000:00010000:0.0:1784403316.845284:0:6293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403316.845312:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.845325:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.845335:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784403316.898970:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1784403316.900038:0:6293:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061088c60 reply state 0000000054f87c57 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403316.900069:0:6293:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784403316.900251:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1784403316.900356:0:6293:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784403316.900540:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:9679:x1871082240886656:12345-192.168.204.28@tcp:36:chown.0 Request processed in 55367us (57801us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784403316.900549:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00010000:00010000:3.0:1784403316.902071:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.902087:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.902095:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.902101:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403316.902106:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.902115:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.902132:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a4884d500) 00010000:00010000:3.0:1784403316.902136:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784403316.902154:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.902160:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afa82c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403316.935959:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403316.936075:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240886784 00000100:00100000:1.0:1784403316.936085:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240886784 00000100:00100000:1.0:1784403316.936144:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:1.0:1784403316.936152:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:9680:x1871082240886784:12345-192.168.204.28@tcp:101:touch.500 00010000:00010000:1.0:1784403316.936176:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403316.936197:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea95 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784403316.939672:0:10011:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3419us 00010000:00010000:3.0:1784403316.966039:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa83a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966063:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa83a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966075:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa83a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966091:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa841 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966098:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966104:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966582:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afa848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966591:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afa848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966598:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afa848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403316.966684:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784403316.966688:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403316.966776:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afa848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966789:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa83a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966796:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa83a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966803:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa83a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.966823:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403316.967343:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa83a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967354:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa83a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967367:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884df00) 00010000:00010000:3.0:1784403316.967370:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403316.967374:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa83a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967380:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa83a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967393:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967408:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa841 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967413:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa841 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967418:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403316.967421:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa841 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967426:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa841 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967434:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c8a43245100) 00010000:00010000:3.0:1784403316.967437:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403316.967440:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa841 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967445:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa841 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967489:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a41671000/0x6828175665afa833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea95 expref: 8 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967504:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afa848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea95 expref: 7 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.967511:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a43245200) 00010000:00010000:3.0:1784403316.967514:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784403316.967522:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7c00, rc 0) 00000100:00100000:3.0:1784403316.967592:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:9680:x1871082240886784:12345-192.168.204.28@tcp:101:touch.500 Request processed in 31438us (31640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403316.967602:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:2.0:1784403316.974725:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784403316.974753:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260846336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403316.974833:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403316.975087:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260846336 00000100:00100000:0.0:1784403316.975095:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260846336 00000100:00100000:0.0:1784403316.975161:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784403316.975172:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260846336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784403316.975210:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784403316.975261:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260846336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403316.975269:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1784403316.975308:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7b5d2a00 x1871082260846336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403316.975329:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260846336:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784403316.975384:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403316.978463:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403316.978561:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240887040 00000100:00100000:2.0:1784403316.978570:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240887040 00000100:00100000:2.0:1784403316.978631:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:2.0:1784403316.978642:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:9680:x1871082240887040:12345-192.168.204.28@tcp:101:touch.500 00010000:00010000:2.0:1784403316.978663:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403316.978684:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa84f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ea9c expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.979232:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa856 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.979250:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa856 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.979262:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa856 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.979334:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.979349:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.979357:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784403316.981178:0:6292:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1784403316.981472:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981486:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981497:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981532:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa856 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981539:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa856 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981546:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa856 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981553:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403316.981557:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa856 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981565:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa856 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981591:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a43245200) 00010000:00010000:2.0:1784403316.981593:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403316.981598:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa856 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981604:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afa856 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403316.981617:0:6292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006522ab93 reply state 0000000043c00c35 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403316.981626:0:6292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784403316.981659:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa84f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea9c expref: 10 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981677:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea9c expref: 9 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.981684:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c8a49e8cd00) 00010000:00010000:2.0:1784403316.981687:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784403316.981689:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2800, rc 0) 00000100:00100000:2.0:1784403316.981759:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:9680:x1871082240887040:12345-192.168.204.28@tcp:101:touch.500 Request processed in 3118us (3307us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784403316.981768:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00010000:00010000:3.0:1784403316.984668:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.984687:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.984694:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.984700:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403316.984704:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.984712:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.984729:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff8c8a49e8ca00) 00010000:00010000:3.0:1784403316.984732:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403316.984737:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403316.984742:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa85d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403316.987339:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403316.987417:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240887296 00000100:00100000:2.0:1784403316.987427:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240887296 00000100:00100000:2.0:1784403316.987490:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:2.0:1784403316.987503:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:9680:x1871082240887296:12345-192.168.204.28@tcp:36:touch.500 00010000:00010000:2.0:1784403316.987584:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403316.987612:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea9c expref: 9 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.987631:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c8a49e8cd00) 00010000:00010000:2.0:1784403316.987641:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403316.987687:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.987701:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403316.987712:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403316.987863:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c22c89b reply state 00000000934b3b16 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403316.987912:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784403316.988010:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:9680:x1871082240887296:12345-192.168.204.28@tcp:36:touch.500 Request processed in 508us (678us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784403316.988018:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:2.0:1784403316.990111:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403316.990197:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240887424 00000100:00100000:0.0:1784403316.990207:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240887424 00000100:00100000:0.0:1784403316.990263:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:0.0:1784403316.990273:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:9680:x1871082240887424:12345-192.168.204.28@tcp:101:touch.500 00010000:00010000:0.0:1784403316.990297:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403316.990317:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afa879 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eaa3 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.990374:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afa879 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaa3 expref: 11 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.990389:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afa879 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaa3 expref: 11 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.990419:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c8a49e8c400) 00010000:00010000:0.0:1784403316.990422:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784403316.990425:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5600, rc 0) 00000100:00100000:0.0:1784403316.990482:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:9680:x1871082240887424:12345-192.168.204.28@tcp:101:touch.500 Request processed in 211us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403316.990490:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00010000:00010000:0.0:1784403316.990725:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.990734:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.990741:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.990748:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403316.990752:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.990759:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.990769:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c8a49e8c400) 00010000:00010000:0.0:1784403316.990772:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403316.990775:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403316.990781:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa872 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403316.996471:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403316.996691:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240887552 00000100:00100000:3.0:1784403316.996702:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240887552 00000100:00100000:3.0:1784403316.996749:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:3.0:1784403316.996771:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1871082240887552:12345-192.168.204.28@tcp:8:touch.500 00010000:00080000:3.0:1784403316.996816:0:7101:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:3.0:1784403316.996847:0:7101:0:(genops.c:1385:class_connect()) connect: client becd6ccb-dd35-46e6-9ecf-44ee31a105f1, cookie 0x6828175665afa880 00002000:00100000:3.0:1784403316.996858:0:7101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli becd6ccb-dd35-46e6-9ecf-44ee31a105f1/ffff8c8a522c3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784403316.996907:0:7101:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784403316.997168:0:7101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784403316.997198:0:7101:0:(import.c:65:import_set_state_nolock()) ffff8c8a522c2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784403316.997267:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2357:x1871082240887552:12345-192.168.204.28@tcp:8:touch.500 Request processed in 495us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403316.997276:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:3.0:1784403317.002435:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403317.002671:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240887680 00000100:00100000:0.0:1784403317.002682:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240887680 00000100:00100000:1.0:1784403317.002857:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:1.0:1784403317.002909:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:0:x1871082240887680:12345-192.168.204.28@tcp:2:touch.500 00000100:00080000:3.0:1784403317.005487:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1784403317.048480:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1784403317.048499:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000100:00100000:1.0:1784403317.048659:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:0:x1871082240887680:12345-192.168.204.28@tcp:2:touch.500 Request processed in 45786us (46226us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1784403317.048670:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:1.0:1784403317.059321:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403317.059594:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240887936 00000100:00100000:2.0:1784403317.059604:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240887936 00000100:00100000:2.0:1784403317.059668:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:2.0:1784403317.059691:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:9680:x1871082240887936:12345-192.168.204.28@tcp:35:touch.500 00000100:00100000:2.0:1784403317.060316:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:9680:x1871082240887936:12345-192.168.204.28@tcp:35:touch.500 Request processed in 623us (1002us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784403317.060324:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:2.0:1784403317.084619:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403317.084918:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240888064 00000100:00100000:0.0:1784403317.084930:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240888064 00000100:00100000:0.0:1784403317.084997:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:0.0:1784403317.085008:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:9681:x1871082240888064:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:0.0:1784403317.085042:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403317.085072:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afa887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eaaa expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.085144:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afa88e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.085158:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afa88e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.085170:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afa88e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403317.085231:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784403317.085236:0:6294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403317.085283:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afa88e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.085308:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afa887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaaa expref: 13 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.085324:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afa88e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaaa expref: 12 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.085351:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a43245200) 00010000:00010000:0.0:1784403317.085355:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403317.085358:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4000, rc 0) 00000100:00100000:0.0:1784403317.085421:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:9681:x1871082240888064:12345-192.168.204.28@tcp:101:rm.0 Request processed in 415us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403317.085428:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:2.0:1784403317.096826:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403317.096957:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240888320 00000100:00100000:0.0:1784403317.096968:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240888320 00000100:00100000:0.0:1784403317.097036:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:0.0:1784403317.097048:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:9681:x1871082240888320:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:0.0:1784403317.097070:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403317.097093:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afa895 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eab1 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403317.097215:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1784403317.097390:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afa895 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eab1 expref: 14 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.097406:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884df00) 00010000:00010000:0.0:1784403317.097409:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784403317.097413:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afa895 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eab1 expref: 14 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.097429:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5c00, rc 0) 00000100:00100000:0.0:1784403317.097513:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:9681:x1871082240888320:12345-192.168.204.28@tcp:101:rm.0 Request processed in 466us (707us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1784403317.097530:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:1.0:1784403317.103385:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403317.104326:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240888448 00000100:00100000:2.0:1784403317.104338:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240888448 00000100:00100000:2.0:1784403317.104548:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:2.0:1784403317.104559:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:9681:x1871082240888448:12345-192.168.204.28@tcp:37:rm.0 00000100:00100000:2.0:1784403317.120708:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:9681:x1871082240888448:12345-192.168.204.28@tcp:37:rm.0 Request processed in 16137us (17318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403317.120722:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:3.0:1784403317.128626:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403317.128720:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240888704 00000100:00100000:1.0:1784403317.128745:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240888704 00000100:00100000:1.0:1784403317.128805:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:1.0:1784403317.128816:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:9681:x1871082240888704:12345-192.168.204.28@tcp:35:rm.0 00000100:00100000:1.0:1784403317.129136:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:9681:x1871082240888704:12345-192.168.204.28@tcp:35:rm.0 Request processed in 320us (518us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784403317.129144:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:0.0:1784403317.138504:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403317.138972:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240888960 00000100:00100000:2.0:1784403317.138984:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240888960 00000100:00100000:2.0:1784403317.139108:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:2.0:1784403317.139119:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:9681:x1871082240888960:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1784403317.139145:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403317.139166:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eab8 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.139303:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa8aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.139319:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa8aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.139346:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa8aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403317.139358:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784403317.139501:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eab8 expref: 17 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.139520:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa8aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eab8 expref: 16 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.139529:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a43245200) 00010000:00010000:2.0:1784403317.139532:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784403317.139535:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3400, rc 0) 00000100:00100000:2.0:1784403317.139605:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:9681:x1871082240888960:12345-192.168.204.28@tcp:101:rm.0 Request processed in 488us (1110us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784403317.139612:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:2.0:1784403317.147621:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403317.149646:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240889088 00000100:00100000:0.0:1784403317.149662:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240889088 00000100:00100000:0.0:1784403317.149777:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:0.0:1784403317.149789:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:9681:x1871082240889088:12345-192.168.204.28@tcp:41:rm.0 00000004:00000024:0.0:1784403317.149853:0:6293:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1784403317.149970:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:9681:x1871082240889088:12345-192.168.204.28@tcp:41:rm.0 Request processed in 183us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403317.149978:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:0.0:1784403317.155376:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403317.155971:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240889216 00000100:00100000:3.0:1784403317.155982:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240889216 00000100:00100000:3.0:1784403317.156057:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:3.0:1784403317.156068:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:9681:x1871082240889216:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1784403317.156107:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403317.156129:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eabf expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156194:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa8bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156211:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa8bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156238:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa8bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156265:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa8c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156273:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156406:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156536:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afa8cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156544:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afa8cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156552:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afa8cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403317.156580:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784403317.156585:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403317.156608:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afa8cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156621:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afa8cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156631:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa8bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156646:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa8bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156653:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa8bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156658:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403317.156663:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa8bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156670:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa8bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156681:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a43245200) 00010000:00010000:3.0:1784403317.156684:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403317.156688:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa8bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156694:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6c00/0x6828175665afa8bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156707:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156713:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa8c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156720:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156724:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403317.156734:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156741:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa8c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156753:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff8c8a43245100) 00010000:00010000:3.0:1784403317.156756:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403317.156759:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa8c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156765:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa8c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156800:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eabf expref: 18 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156813:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afa8cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eabf expref: 17 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.156820:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c8a49e8c400) 00010000:00010000:3.0:1784403317.156822:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403317.156824:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6800, rc 0) 00000100:00100000:3.0:1784403317.156949:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:9681:x1871082240889216:12345-192.168.204.28@tcp:101:rm.0 Request processed in 881us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403317.156956:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:1.0:1784403317.164730:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403317.164951:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240889472 00000100:00100000:2.0:1784403317.164963:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240889472 00000100:00100000:2.0:1784403317.165039:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:2.0:1784403317.165051:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:9681:x1871082240889472:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1784403317.165110:0:6292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784403317.165139:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afa8cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eabf expref: 17 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165163:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afa879 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaa3 expref: 16 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165198:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c8a49e8c400) 00010000:00010000:2.0:1784403317.165242:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afa88e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaaa expref: 15 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165252:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a43245200) 00010000:00010000:2.0:1784403317.165255:0:6292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403317.165277:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165291:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165302:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165318:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165325:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165331:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165513:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa8e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165524:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa8e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.165541:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa8e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784403317.166789:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1784403317.166802:0:6292:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322734935240ns, next at 323734932840ns, rc = 0 00010000:00010000:3.0:1784403317.166891:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.166921:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.166932:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.166941:0:6292:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.166947:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.166954:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.166977:0:6292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403317.166999:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa8e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.167007:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa8e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.167014:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa8e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.167021:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403317.167032:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403317.167038:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.167039:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa8e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.167056:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403317.167059:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa8e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.167062:0:6280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.167073:0:6280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.167102:0:6280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c8a49e8c600) 00010000:00010000:0.0:1784403317.167105:0:6280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784403317.167109:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.167115:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afa8e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403317.167134:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403317.167136:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403317.167137:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403317.170219:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c8a49e8c600) 00010000:00010000:3.0:1784403317.170230:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784403317.170249:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa8e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.170261:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afa8e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.170365:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.170374:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.170380:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.170386:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403317.170390:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.170397:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.170411:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a43245200) 00010000:00010000:3.0:1784403317.170414:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403317.170417:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.170423:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afa8d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784403317.170453:0:6292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004943f928 reply state 00000000f69ddae3 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403317.170462:0:6292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784403317.170572:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:9681:x1871082240889472:12345-192.168.204.28@tcp:36:rm.0 Request processed in 5518us (5847us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784403317.170583:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00010000:00010000:3.0:1784403317.175040:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.175059:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.175066:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.175073:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403317.175078:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.175086:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.175104:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff8c8a49e8cd00) 00010000:00010000:3.0:1784403317.175107:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403317.175111:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.175117:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afa8db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403317.177702:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403317.177811:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240889728 00000100:00100000:2.0:1784403317.177822:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240889728 00000100:00100000:2.0:1784403317.177902:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:2.0:1784403317.177913:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:9681:x1871082240889728:12345-192.168.204.28@tcp:35:rm.0 00000100:00100000:2.0:1784403317.178181:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:9681:x1871082240889728:12345-192.168.204.28@tcp:35:rm.0 Request processed in 269us (488us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784403317.178189:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:0.0:1784403317.181681:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403317.182350:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240889984 00000100:00100000:2.0:1784403317.182362:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240889984 00000100:00100000:2.0:1784403317.182425:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:2.0:1784403317.182437:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:9681:x1871082240889984:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1784403317.182501:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784403317.182530:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afa8aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eab8 expref: 16 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.182552:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afa848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea95 expref: 15 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.182565:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a43245200) 00010000:00010000:2.0:1784403317.182582:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa809 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea87 expref: 14 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.182591:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884df00) 00010000:00010000:2.0:1784403317.182613:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403317.182637:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa8f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.182651:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.182662:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.182674:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.182681:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.182687:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.186695:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afa8fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.186715:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afa8fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.186727:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afa8fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403317.191747:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784403317.191785:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afa8fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.191797:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afa8fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.191815:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afa8fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.191822:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403317.191827:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afa8fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.191834:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afa8fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.191851:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c8a49e8c800) 00010000:00010000:2.0:1784403317.191855:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784403317.191859:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afa8fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.192214:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afa8fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.192245:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.192252:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa8f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.192258:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa8f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.192263:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403317.192266:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa8f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.192350:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa8f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.192361:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a49e8c400) 00010000:00010000:2.0:1784403317.192364:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403317.192368:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa8f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.192373:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afa8f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403317.192388:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c055b408 reply state 0000000051db27f2 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403317.192398:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784403317.192743:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:9681:x1871082240889984:12345-192.168.204.28@tcp:36:rm.0 Request processed in 10303us (11068us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784403317.192753:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00010000:00010000:2.0:1784403317.195949:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.195967:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.195975:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.195981:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403317.195985:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.196011:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.196037:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c8a49e8c700) 00010000:00010000:2.0:1784403317.196040:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403317.196045:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403317.196052:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afa8f7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403317.599714:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403318.638470:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403319.007629:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260846848:0@lo:400:kworker.0 00000100:00100000:2.0:1784403319.007698:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403319.007714:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260846464:0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.007748:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403319.007772:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260846976:0@lo:400:kworker.0 00000100:00100000:2.0:1784403319.007772:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260846464 00000100:00100000:2.0:1784403319.007779:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260846464 00000100:00100000:3.0:1784403319.007794:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403319.007819:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784403319.007820:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260846720:0@lo:400:kworker.0 00000100:00100000:2.0:1784403319.007827:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260846464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403319.007890:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260846464:12345-0@lo:400:kworker.0 Request processed in 63us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403319.007898:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784403319.008195:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403319.008220:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784403319.008226:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260846592:0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.008252:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403319.008269:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260847104:0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.008289:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403319.008318:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260846848 00000100:00100000:3.0:1784403319.008322:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260846848 00000100:00100000:3.0:1784403319.008375:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260847104 00000100:00100000:3.0:1784403319.008378:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260847104 00000100:00100000:3.0:1784403319.008400:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784403319.008408:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260846848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.008445:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260846848:12345-0@lo:400:kworker.0 Request processed in 39us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403319.008450:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784403319.008463:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784403319.008484:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260847104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.008510:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260847104:12345-0@lo:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403319.008525:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784403319.008545:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260846976 00000100:00100000:3.0:1784403319.008549:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260846976 00000100:00100000:3.0:1784403319.008570:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260846720 00000100:00100000:3.0:1784403319.008573:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260846720 00000100:00100000:3.0:1784403319.008585:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260846592 00000100:00100000:3.0:1784403319.008588:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260846592 00000100:00100000:3.0:1784403319.008599:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784403319.008604:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260846976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.008631:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260846976:12345-0@lo:400:kworker.0 Request processed in 27us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403319.008636:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784403319.008648:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784403319.008653:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260846720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.008673:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260846720:12345-0@lo:400:kworker.0 Request processed in 21us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403319.008678:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784403319.008687:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784403319.008691:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260846592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.008711:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260846592:12345-0@lo:400:kworker.0 Request processed in 19us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403319.008716:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1784403319.008741:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784403319.008745:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784403319.008747:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403319.008777:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260846464:0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.008801:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260846976:0@lo:400:kworker.0 00010000:00080000:3.0:1784403319.008835:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a52372d80 x1871082260846848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403319.008844:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260846848:0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.008858:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260846592:0@lo:400:kworker.0 00010000:00080000:3.0:1784403319.008883:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1a680 x1871082260847104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403319.008891:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260847104:0@lo:400:kworker.0 00000100:00100000:3.0:1784403319.008899:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260846720:0@lo:400:kworker.0 00000100:00100000:1.0:1784403319.519241:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784403319.524482:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260847232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403319.524564:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403319.524854:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260847232 00000100:00100000:2.0:1784403319.524862:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260847232 00000100:00100000:2.0:1784403319.524950:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784403319.524959:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260847232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403319.525008:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403319.525054:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260847232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403319.525071:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1784403319.525902:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1aa00 x1871082260847232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403319.525927:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260847232:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784403319.659785:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403320.671288:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784403321.102224:0:11981:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1784403321.409975:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403321.410016:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403321.410127:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403321.410171:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403321.410207:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240890368 00000100:00100000:0.0:1784403321.410217:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240890368 00000100:00100000:0.0:1784403321.410283:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:0.0:1784403321.410303:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240890368:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403321.410384:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240890368:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 91us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403321.410391:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00080000:0.0:1784403321.410411:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403321.410670:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240890112 00000100:00100000:2.0:1784403321.410678:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240890112 00000100:00100000:2.0:1784403321.410724:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 253 00000100:00100000:2.0:1784403321.410734:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240890112:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403321.410773:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240890112:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 41us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403321.410780:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 253 00000100:00100000:1.0:1784403321.416503:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240890240 00000100:00100000:1.0:1784403321.416519:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240890240 00000100:00100000:1.0:1784403321.416614:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240890496 00000100:00100000:1.0:1784403321.416618:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240890496 00000100:00100000:1.0:1784403321.416656:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 105 00000100:00100000:1.0:1784403321.416667:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2360:x1871082240890240:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403321.416734:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 106 00000100:00100000:2.0:1784403321.416748:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240890496:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403321.416765:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2360:x1871082240890240:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 98us (6896us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403321.416773:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 105 00000100:00100000:2.0:1784403321.416785:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240890496:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 40us (6766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403321.416793:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 106 00000100:00080000:0.0:1784403321.416966:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784403321.695075:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784403322.085310:0:7280:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327653441929ns, next at 328653439217ns, rc = 0 00000100:00100000:0.0:1784403322.085376:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260847360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403322.085445:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403322.085960:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260847360 00000100:00100000:2.0:1784403322.085970:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260847360 00000100:00100000:2.0:1784403322.086029:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784403322.086038:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260847360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403322.086072:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403322.086117:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260847360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403322.086123:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1784403322.086142:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784403322.086654:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7b5d3480 x1871082260847360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403322.086673:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260847360:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1784403322.149986:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:3.0:1784403322.150006:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:3.0:1784403322.150012:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1784403322.150035:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1784403322.150311:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260847488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784403322.150403:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403322.150606:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260847488 00000100:00100000:3.0:1784403322.150615:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260847488 00000100:00100000:3.0:1784403322.150661:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784403322.150672:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260847488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1784403322.150706:0:8571:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1784403322.150837:0:8571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a5bd575, atime: 0x6a5bd575, ctime: 0x6a5bd575, blocks: 0x1 00010000:00010000:3.0:1784403322.150846:0:8571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afa905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.150863:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1784403322.150894:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403322.150902:0:8571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afa905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.150918:0:8571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afa905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.150928:0:8571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afa905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.150946:0:8571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afa905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.150968:0:8571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784403322.151211:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403322.151219:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afa905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403322.151229:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403322.151234:0:6280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afa905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403322.151245:0:6280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afa905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403322.151268:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afa905 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403322.151276:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afa905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403322.151298:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403322.151301:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403322.151303:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403322.153760:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3568:x1871082260847488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3033us (3302us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784403322.153774:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1784403322.153901:0:3568:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a7b5d3480/2, rc 0, transno 4294967300 00000100:00100000:0.0:1784403322.153910:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260847488:0@lo:6:osp-syn-0-0.0 00000020:00000080:0.0:1784403322.201242:0:12031:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde9919a20 20000000:00000080:0.0:1784403322.201260:0:12031:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c8a73a2d400 uarg=0000000000000000 20000000:01000000:0.0:1784403322.201304:0:12031:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1784403322.201311:0:12031:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1784403322.201315:0:12031:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1784403322.203412:0:12032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1784403322.204175:0:12031:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1784403322.211395:0:12031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1784403322.211456:0:12031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1784403322.211514:0:12031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1784403322.211534:0:12031:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784403322.211555:0:12031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.211577:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a41670400/0x6828175665afa7a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea72 expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.211585:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afa7ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea79 expref: 12 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.211606:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa7bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa7b5 expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.211614:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce7000/0x6828175665afa7ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa7c3 expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.211621:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa7d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa7d1 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.211629:0:12031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.211672:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa7d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa7d1 expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.211688:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa7d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa7d1 expref: 18 pid: 6286 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403322.211702:0:12031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1871082260847616:0@lo:104: 00000100:00100000:3.0:1784403322.211782:0:12031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784403322.211839:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce7000/0x6828175665afa7ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa7c3 expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.211848:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a7fce7000/0x6828175665afa7ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa7c3 expref: 18 pid: 6287 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403322.211857:0:12031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52372d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1871082260847744:0@lo:104: 00000100:00100000:3.0:1784403322.211911:0:12031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784403322.211948:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa7bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afa7b5 expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.211964:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa7bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afa7b5 expref: 18 pid: 6287 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403322.211973:0:12031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1871082260847872:0@lo:104: 00000100:00100000:3.0:1784403322.212000:0:12031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784403322.212027:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afa7ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea79 expref: 12 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.212038:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afa7ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea79 expref: 12 pid: 6286 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403322.212048:0:12031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1871082260848000:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403322.212221:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a41670400/0x6828175665afa7a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea72 expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.212231:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a41670400/0x6828175665afa7a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea72 expref: 12 pid: 6287 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403322.212239:0:12031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1871082260848128:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403322.212267:0:12031:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ad300 going to sleep for 11 seconds 00000100:00100000:1.0:1784403322.212526:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260847616 00000100:00100000:1.0:1784403322.212541:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260847616 00000100:00100000:1.0:1784403322.212579:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260847744 00000100:00100000:1.0:1784403322.212582:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260847744 00000100:00100000:1.0:1784403322.212591:0:6275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260847872 00000100:00100000:1.0:1784403322.212593:0:6275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260847872 00000100:00100000:1.0:1784403322.212606:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784403322.212615:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+5:12031:x1871082260847616:12345-0@lo:104: 00010000:00010000:1.0:1784403322.212628:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.212679:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784403322.212685:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+5:12031:x1871082260847616:12345-0@lo:104: Request processed in 72us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403322.212692:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784403322.212721:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784403322.212727:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+4:12031:x1871082260847744:12345-0@lo:104: 00010000:00010000:1.0:1784403322.212734:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.212769:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784403322.212774:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+4:12031:x1871082260847744:12345-0@lo:104: Request processed in 48us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403322.212780:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784403322.212793:0:6275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784403322.212799:0:6275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:12031:x1871082260847872:12345-0@lo:104: 00010000:00010000:1.0:1784403322.212805:0:6275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.212835:0:6275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784403322.212846:0:6275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64472369-fee1-4bb4-a407-7797860a37a0+3:12031:x1871082260847872:12345-0@lo:104: Request processed in 48us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403322.212852:0:6275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1784403322.212914:0:8813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784403322.212921:0:8813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.212939:0:8813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4600 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403322.212943:0:8813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.212953:0:8813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403322.212960:0:8813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403322.212966:0:8813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784403322.212997:0:8813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213003:0:8813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403322.213025:0:8813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213033:0:8813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afa7d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa7d8 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213047:0:8813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403322.213051:0:8813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213066:0:8813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4800 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403322.213069:0:8813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213075:0:8813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403322.213082:0:8813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403322.213086:0:8813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784403322.213100:0:8813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213105:0:8813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403322.213111:0:8813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213118:0:8813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4800/0x6828175665afa7c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa7ca expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213126:0:8813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403322.213128:0:8813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213134:0:8813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403322.213136:0:8813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213152:0:8813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403322.213159:0:8813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403322.213164:0:8813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784403322.213176:0:8813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213181:0:8813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403322.213196:0:8813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213203:0:8813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3000/0x6828175665afa7b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afa7bc expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213215:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403322.213217:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403322.213219:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403322.213225:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403322.213230:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403322.213249:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260848256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403322.213280:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403322.213303:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784403322.213309:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260848384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403322.213329:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403322.213357:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260848512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403322.213391:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403322.213422:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260848256 00000100:00100000:1.0:1784403322.213426:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260848256 00010000:00010000:1.0:1784403322.213445:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa7d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa7d1 expref: 19 pid: 6286 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403322.213458:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260848384 00000100:00100000:1.0:1784403322.213461:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260848384 00010000:00010000:1.0:1784403322.213470:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce7000/0x6828175665afa7ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa7c3 expref: 20 pid: 6287 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403322.213480:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260848512 00000100:00100000:1.0:1784403322.213482:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260848512 00010000:00010000:1.0:1784403322.213491:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa7bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa7b5 expref: 21 pid: 6287 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403322.213503:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784403322.213509:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+21:3565:x1871082260848256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403322.213519:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403322.213524:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa7d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa7d1 expref: 21 pid: 6286 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213535:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa7d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa7d1 expref: 21 pid: 6286 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213555:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403322.213583:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+21:3565:x1871082260848256:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403322.213590:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784403322.213602:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784403322.213615:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+20:3565:x1871082260848384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403322.213622:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403322.213626:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce7000/0x6828175665afa7ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa7c3 expref: 20 pid: 6287 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213634:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce7000/0x6828175665afa7ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa7c3 expref: 20 pid: 6287 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213643:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403322.213664:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+20:3565:x1871082260848384:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403322.213670:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784403322.213682:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784403322.213688:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260848512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403322.213694:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403322.213698:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa7bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afa7b5 expref: 19 pid: 6287 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213706:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa7bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afa7b5 expref: 19 pid: 6287 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.213715:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403322.213739:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260848512:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403322.213746:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784403322.213805:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260848512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403322.213827:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260848384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403322.213835:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260848256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403322.214111:0:12031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6200/0x6828175665afa7d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa7d1 expref: 18 pid: 6286 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403322.214123:0:12031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1871082260847616:0@lo:104: 00010000:00010000:3.0:1784403322.214134:0:12031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce7000/0x6828175665afa7ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa7c3 expref: 17 pid: 6287 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403322.214153:0:12031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52372d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1871082260847744:0@lo:104: 00010000:00010000:3.0:1784403322.214166:0:12031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa7bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afa7b5 expref: 16 pid: 6287 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403322.214173:0:12031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1871082260847872:0@lo:104: 00000100:00100000:3.0:1784403322.217844:0:12031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1871082260848000:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403322.218154:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403322.218224:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240890624 00000100:00100000:1.0:1784403322.218233:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240890624 00010000:00010000:1.0:1784403322.218270:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afa7ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea79 expref: 13 pid: 6286 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403322.218312:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:1.0:1784403322.218322:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73641500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2361:x1871082240890624:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403322.218338:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403322.218343:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afa7ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea79 expref: 13 pid: 6286 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.218355:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afa7ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea79 expref: 13 pid: 6286 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.218374:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afa7ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea79 expref: 13 pid: 6286 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.218391:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403322.218449:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73641500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:2361:x1871082240890624:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 129us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403322.218456:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:2.0:1784403322.232964:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403322.233054:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240890752 00000100:00100000:1.0:1784403322.233063:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240890752 00010000:00010000:1.0:1784403322.233104:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a41670400/0x6828175665afa7a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea72 expref: 12 pid: 6287 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403322.233139:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:1.0:1784403322.233148:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:2360:x1871082240890752:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403322.233182:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403322.233188:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a41670400/0x6828175665afa7a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea72 expref: 12 pid: 6287 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233201:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a41670400/0x6828175665afa7a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea72 expref: 12 pid: 6287 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233224:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233232:0:6278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233249:0:6278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233257:0:6278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233264:0:6278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233270:0:6278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233277:0:6278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403322.233281:0:6278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233290:0:6278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233309:0:6278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.233320:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403322.233381:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:2360:x1871082240890752:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 233us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403322.233391:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00010000:00010000:3.0:1784403322.233507:0:12031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41670400/0x6828175665afa7a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea72 expref: 11 pid: 6287 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403322.233521:0:12031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1871082260848128:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403322.233555:0:12031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.233564:0:12031:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.233570:0:12031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403322.233576:0:12031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afa90c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403322.719040:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403323.388671:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403323.392418:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240890880 00000100:00100000:2.0:1784403323.392450:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240890880 00000100:00100000:2.0:1784403323.392639:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 254 00000100:00100000:2.0:1784403323.392651:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49cf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:5576:x1871082240890880:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403323.392669:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403323.392689:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b2e00/0x6828175665afa913 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eac6 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403323.392717:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b2e00/0x6828175665afa913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eac6 expref: 12 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403323.392728:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b2e00/0x6828175665afa913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eac6 expref: 12 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403323.392738:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2e00, rc 0) 00000100:00100000:2.0:1784403323.392811:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49cf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:5576:x1871082240890880:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 161us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403323.392818:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 254 00000100:00100000:2.0:1784403323.408462:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403323.410757:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240891008 00000100:00100000:0.0:1784403323.410772:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240891008 00000100:00100000:1.0:1784403323.416990:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 255 00000100:00100000:1.0:1784403323.418027:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49cf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:5576:x1871082240891008:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403323.419032:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49cf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:5576:x1871082240891008:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 1012us (10576us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403323.423288:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403323.423554:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240891136 00000100:00100000:3.0:1784403323.423564:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240891136 00000100:00100000:3.0:1784403323.423628:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 256 00000100:00100000:3.0:1784403323.423643:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240891136:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403323.423923:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240891136:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 281us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403323.423938:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 256 00000100:00100000:2.0:1784403323.429151:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403323.429231:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240891264 00000100:00100000:3.0:1784403323.429240:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240891264 00000100:00100000:3.0:1784403323.429292:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 257 00000100:00100000:3.0:1784403323.429301:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:9951:x1871082240891264:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784403323.429549:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:9951:x1871082240891264:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 248us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403323.429557:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 257 00000100:00100000:1.0:1784403323.432801:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 255 00000100:00100000:2.0:1784403323.437820:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403323.437997:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240891392 00000100:00100000:3.0:1784403323.438007:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240891392 00000100:00100000:3.0:1784403323.438070:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 258 00000100:00100000:3.0:1784403323.438081:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:9951:x1871082240891392:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784403323.440046:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:9951:x1871082240891392:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 1955us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403323.440061:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 258 00000100:00100000:2.0:1784403323.470382:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403323.470573:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240891520 00000100:00100000:1.0:1784403323.470584:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240891520 00000100:00100000:1.0:1784403323.470644:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 259 00000100:00100000:1.0:1784403323.470653:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:5576:x1871082240891520:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403323.470669:0:6287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403323.470686:0:6287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a41670400/0x6828175665afa91a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eacd expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403323.470712:0:6287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41670400/0x6828175665afa91a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eacd expref: 13 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403323.470723:0:6287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a41670400/0x6828175665afa91a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eacd expref: 13 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403323.470748:0:6287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a41670400, rc 0) 00000100:00100000:1.0:1784403323.470804:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240891520:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 152us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403323.470811:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 259 00000100:00100000:2.0:1784403323.480742:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403323.480843:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240891648 00000100:00100000:3.0:1784403323.480854:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240891648 00000100:00100000:2.0:1784403323.495526:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 260 00000100:00100000:2.0:1784403323.495605:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240891648:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403323.495956:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240891648:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 418us (15223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403323.495974:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 260 00000100:00100000:2.0:1784403323.502042:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403323.502131:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240891776 00000100:00100000:0.0:1784403323.502141:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240891776 00000100:00100000:0.0:1784403323.502198:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 261 00000100:00100000:0.0:1784403323.502208:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240891776:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403323.502459:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:5576:x1871082240891776:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 252us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403323.502468:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 261 00000100:00100000:3.0:1784403323.507008:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403323.510431:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240891904 00000100:00100000:1.0:1784403323.510447:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240891904 00000100:00100000:1.0:1784403323.510528:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 262 00000100:00100000:1.0:1784403323.510548:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:9954:x1871082240891904:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784403323.510815:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:9954:x1871082240891904:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 276us (3816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403323.510824:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 262 00000100:00100000:1.0:1784403323.520951:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403323.521062:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240892032 00000100:00100000:2.0:1784403323.521072:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240892032 00000100:00100000:0.0:1784403323.521209:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 263 00000100:00100000:0.0:1784403323.521221:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:9954:x1871082240892032:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784403323.521488:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:9954:x1871082240892032:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 268us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403323.521497:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 263 00010000:00010000:3.0:1784403323.748283:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784403323.936605:0:6290:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784403323.936613:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a42cc6000 from 7 10000000:01000000:1.0:1784403323.936618:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784403323.936669:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403323.936682:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403323.936695:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403323.936725:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260848640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784403323.936801:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403323.936938:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a489a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1784403323.936964:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260848640 00000100:00100000:0.0:1784403323.936972:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260848640 00000100:00100000:0.0:1784403323.937039:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1784403323.937050:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+16:6290:x1871082260848640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403323.937064:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403323.937081:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa928 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa921 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403323.937112:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa928 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa921 expref: 17 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403323.937125:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa928 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa921 expref: 17 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403323.937134:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5c00, rc 0) 00000100:00100000:0.0:1784403323.937319:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260848640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403323.937326:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784403323.939430:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260848640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403323.939461:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403323.939474:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403323.939600:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260848768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403323.939651:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403323.939772:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a489a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1784403323.940126:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260848768 00000100:00100000:3.0:1784403323.940133:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260848768 00000100:00100000:3.0:1784403323.940233:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1784403323.940244:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260848768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403323.940539:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260848768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403323.940555:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784403323.940637:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260848768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403323.940674:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260848896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784403323.940728:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403323.941816:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a489a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1784403323.941932:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260848896 00000100:00100000:2.0:1784403323.941939:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260848896 00000100:00100000:2.0:1784403323.942087:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784403323.942098:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260848896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403323.942312:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260848896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403323.942319:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1784403323.942425:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260848896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784403323.945226:0:12044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12044:1871082260849024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403323.945320:0:12044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403323.945356:0:12044:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a489a9900 going to sleep for 11 seconds 00000100:00100000:2.0:1784403323.945421:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260849024 00000100:00100000:2.0:1784403323.945429:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260849024 00000100:00100000:2.0:1784403323.945466:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784403323.945476:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+17:12044:x1871082260849024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403323.945724:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+17:12044:x1871082260849024:12345-0@lo:502:llog_process_th.0 Request processed in 248us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403323.945732:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784403323.946139:0:12044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12044:1871082260849024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784403323.946170:0:12044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403323.946180:0:12044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403323.946183:0:12044:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784403323.946190:0:12044:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c8a42cc6000 00000020:00000080:1.0:1784403323.946193:0:12044:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784403323.946319:0:12044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12044:1871082260849152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403323.946364:0:12044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403323.946383:0:12044:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a489a9900 going to sleep for 11 seconds 00000100:00100000:0.0:1784403323.947122:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260849152 00000100:00100000:0.0:1784403323.947130:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260849152 00000100:00100000:0.0:1784403323.947186:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784403323.947196:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:12044:x1871082260849152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403323.947571:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:12044:x1871082260849152:12345-0@lo:502:llog_process_th.0 Request processed in 375us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403323.947578:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784403323.947921:0:12044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12044:1871082260849152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784403323.947947:0:12044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403323.948055:0:12044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403323.948058:0:12044:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1784403323.948064:0:12044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1784403323.951753:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1784403323.951779:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784403323.951792:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403323.951805:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403323.951816:0:6290:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784403323.951818:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a43036800 from 7 10000000:01000000:3.0:1784403323.951822:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784403323.951860:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403323.951888:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403323.951912:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403323.951946:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260849280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784403323.952016:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403323.952075:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403323.952112:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260849280 00000100:00100000:3.0:1784403323.952119:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260849280 00000100:00100000:3.0:1784403323.952170:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784403323.952179:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49dd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+17:6290:x1871082260849280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403323.952193:0:6286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403323.952212:0:6286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa936 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa92f expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403323.952236:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa92f expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403323.952247:0:6286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa92f expref: 18 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403323.952256:0:6286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7200, rc 0) 00000100:00100000:3.0:1784403323.952299:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49dd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260849280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403323.952306:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784403323.952966:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260849280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403323.952986:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403323.952995:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403323.953782:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260849408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403323.953833:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403323.953916:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a489a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1784403323.954203:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260849408 00000100:00100000:3.0:1784403323.954210:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260849408 00000100:00100000:3.0:1784403323.954256:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1784403323.954265:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260849408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403323.955801:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260849408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403323.955863:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260849536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403323.956660:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260849408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2392us (2822us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403323.956670:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784403323.956760:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403323.956808:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43e28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784403323.958580:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260849536 00000100:00100000:3.0:1784403323.958594:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260849536 00000100:00100000:3.0:1784403323.958660:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784403323.958670:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260849536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403323.959370:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260849536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 699us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403323.959380:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784403323.961395:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260849536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403323.966037:0:12047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12047:1871082260849664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403323.967137:0:12047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403323.967284:0:12047:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1784403323.969273:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260849664 00000100:00100000:0.0:1784403323.969287:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260849664 00000100:00100000:0.0:1784403323.969787:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784403323.969800:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:12047:x1871082260849664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403323.970478:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:12047:x1871082260849664:12345-0@lo:502:llog_process_th.0 Request processed in 679us (3339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403323.970488:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784403323.971802:0:12047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12047:1871082260849664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784403323.971847:0:12047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784403323.971859:0:12047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403323.971862:0:12047:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784403323.971889:0:12047:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c8a43036800 00000020:00000080:3.0:1784403323.971892:0:12047:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784403323.972012:0:12047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12047:1871082260849792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403323.972430:0:12047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403323.972479:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260849792 00000100:00100000:3.0:1784403323.972486:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260849792 00000100:00100000:3.0:1784403323.972528:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784403323.972537:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:12047:x1871082260849792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403323.972805:0:12047:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ad840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403323.972894:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+18:12047:x1871082260849792:12345-0@lo:502:llog_process_th.0 Request processed in 356us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403323.972916:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1784403323.972952:0:12047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12047:1871082260849792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784403323.972980:0:12047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403323.972990:0:12047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403323.972993:0:12047:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784403323.972997:0:12047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1784403323.973518:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1784403323.973540:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784403323.973551:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403323.973563:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403323.973574:0:6290:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784403323.973577:0:6290:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a5270b000 from 7 10000000:01000000:3.0:1784403323.973580:0:6290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784403323.973614:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403323.973622:0:6290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403323.973631:0:6290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403323.973649:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260849920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784403323.974303:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403323.974543:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ad840 going to sleep for 11 seconds 00000100:00100000:1.0:1784403323.974609:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260849920 00000100:00100000:1.0:1784403323.974616:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260849920 00000100:00100000:1.0:1784403323.974661:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1784403323.974670:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+18:6290:x1871082260849920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403323.974689:0:6285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403323.974704:0:6285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a41670800/0x6828175665afa944 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afa93d expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403323.974729:0:6285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a41670800/0x6828175665afa944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afa93d expref: 19 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403323.974754:0:6285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a41670800/0x6828175665afa944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afa93d expref: 19 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403323.974763:0:6285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a41670800, rc 0) 00000100:00100000:1.0:1784403323.974804:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260849920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403323.974812:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784403323.974965:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260849920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403323.974982:0:6290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403323.974991:0:6290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403323.975758:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260850048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403323.975947:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403323.977407:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ad840 going to sleep for 11 seconds 00000100:00100000:1.0:1784403323.993558:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260850048 00000100:00100000:1.0:1784403323.993574:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260850048 00000100:00100000:1.0:1784403323.993642:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1784403323.993653:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260850048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403323.994013:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260850048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (18144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403323.994021:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1784403323.994787:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260850048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403323.994850:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260850176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403323.994973:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403323.995012:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ad840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403323.995473:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260850176 00000100:00100000:3.0:1784403323.995480:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260850176 00000100:00100000:3.0:1784403323.995572:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1784403323.995582:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260850176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403323.995794:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:6290:x1871082260850176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403323.995809:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1784403323.995921:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64472369-fee1-4bb4-a407-7797860a37a0:6290:1871082260850176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403323.996147:0:12048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12048:1871082260850304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403323.996187:0:12048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403323.998796:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260850304 00000100:00100000:2.0:1784403323.998999:0:12048:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7349e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403323.999317:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260850304 00000040:00080000:2.0:1784403324.000779:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784403324.000991:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784403324.001006:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:12048:x1871082260850304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403324.001310:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:12048:x1871082260850304:12345-0@lo:502:llog_process_th.0 Request processed in 307us (5122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403324.001318:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1784403324.002192:0:12048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12048:1871082260850304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784403324.002236:0:12048:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784403324.002249:0:12048:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403324.002252:0:12048:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784403324.002260:0:12048:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c8a5270b000 00000020:00000080:2.0:1784403324.002263:0:12048:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784403324.002397:0:12048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12048:1871082260850432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403324.002451:0:12048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403324.002503:0:12048:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7349e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403324.003242:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260850432 00000100:00100000:3.0:1784403324.003252:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260850432 00000100:00100000:3.0:1784403324.003314:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1784403324.003324:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:12048:x1871082260850432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403324.003551:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:12048:x1871082260850432:12345-0@lo:502:llog_process_th.0 Request processed in 228us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403324.003559:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1784403324.003670:0:12048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64472369-fee1-4bb4-a407-7797860a37a0:12048:1871082260850432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784403324.003710:0:12048:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403324.003717:0:12048:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403324.003719:0:12048:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784403324.003723:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1784403324.004034:0:6290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1784403324.004056:0:6290:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784403324.004068:0:6290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403324.004080:0:6290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403324.127125:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784403324.127281:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260850688:0@lo:400:kworker.0 00000100:00100000:1.0:1784403324.127382:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403324.127456:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784403324.127462:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260850816:0@lo:400:kworker.0 00000100:00100000:1.0:1784403324.127492:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403324.127545:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260850816 00000100:00100000:1.0:1784403324.127553:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260850816 00000100:00100000:1.0:1784403324.127613:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784403324.127625:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260850816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403324.127690:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260850816:12345-0@lo:400:kworker.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403324.127707:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1784403324.127730:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403324.127762:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260850816:0@lo:400:kworker.0 00000100:00100000:3.0:1784403324.129407:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260850688 00000100:00100000:3.0:1784403324.129425:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260850688 00000100:00100000:3.0:1784403324.129506:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784403324.129520:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260850688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403324.129607:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260850688:12345-0@lo:400:kworker.0 Request processed in 92us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403324.129614:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784403324.130427:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260850944:0@lo:400:kworker.0 00000100:00100000:0.0:1784403324.130477:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403324.130624:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260850560:0@lo:400:kworker.0 00000100:00100000:0.0:1784403324.130647:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403324.130685:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260850944 00000100:00100000:0.0:1784403324.130795:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260850944 00000100:00100000:3.0:1784403324.130825:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260850688:0@lo:400:kworker.0 00000100:00100000:0.0:1784403324.130938:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260850560 00000100:00100000:0.0:1784403324.130942:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260850560 00000100:00100000:3.0:1784403324.130953:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1784403324.130980:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403324.131098:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260850944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403324.133590:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260850944:12345-0@lo:400:kworker.0 Request processed in 2626us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403324.133804:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260851072:0@lo:400:kworker.0 00000100:00100000:1.0:1784403324.133850:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403324.134174:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260851072 00000100:00100000:2.0:1784403324.134183:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260851072 00000100:00100000:1.0:1784403324.134195:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260850944:0@lo:400:kworker.0 00000100:00080000:1.0:1784403324.134218:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784403324.134251:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784403324.134260:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260851072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403324.134314:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260851072:12345-0@lo:400:kworker.0 Request processed in 54us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403324.134321:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1784403324.134451:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77e38380 x1871082260851072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403324.134461:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260851072:0@lo:400:kworker.0 00000100:00100000:0.0:1784403324.136317:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784403324.136336:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260850560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403324.136430:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260850560:12345-0@lo:400:kworker.0 Request processed in 103us (5781us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403324.136439:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784403324.136539:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784403324.137584:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260850560:0@lo:400:kworker.0 00000100:00100000:1.0:1784403324.642703:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784403324.642731:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260851200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403324.642801:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403324.643510:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260851200 00000100:00100000:2.0:1784403324.643520:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260851200 00000100:00100000:3.0:1784403324.643680:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784403324.643693:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260851200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403324.643732:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403324.643804:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260851200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403324.643811:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1784403324.643923:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77e38700 x1871082260851200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403324.643946:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260851200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784403324.767110:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784403325.023680:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784403325.791075:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403326.530156:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403326.530212:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403326.530250:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403326.530292:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403326.530337:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240892288 00000100:00100000:2.0:1784403326.530348:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240892288 00000100:00100000:2.0:1784403326.530408:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240892544 00000100:00100000:2.0:1784403326.530411:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240892544 00000100:00100000:2.0:1784403326.530439:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 110 00000100:00100000:2.0:1784403326.530449:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240892288:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403326.530527:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240892288:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403326.530537:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 110 00000100:00100000:2.0:1784403326.530553:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 111 00000100:00100000:2.0:1784403326.530560:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2358:x1871082240892544:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403326.530586:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2358:x1871082240892544:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403326.531145:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240892160 00000100:00100000:0.0:1784403326.531152:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240892160 00000100:00100000:0.0:1784403326.531198:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 279 00000100:00100000:0.0:1784403326.531206:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240892160:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403326.531241:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240892160:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 36us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403326.531247:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 279 00000100:00100000:2.0:1784403326.531437:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 111 00000100:00080000:1.0:1784403326.531648:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784403326.531665:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240892416 00000100:00100000:1.0:1784403326.531670:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240892416 00000100:00100000:1.0:1784403326.531713:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:1.0:1784403326.531721:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240892416:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403326.531779:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240892416:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 58us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403326.531786:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00080000:2.0:1784403326.533239:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784403326.815500:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403327.199390:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784403327.199415:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260851328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784403327.199490:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403327.199571:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260851328 00000100:00100000:3.0:1784403327.199578:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260851328 00000100:00100000:3.0:1784403327.199635:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784403327.199646:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260851328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784403327.201431:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403327.201539:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260851328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1892us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403327.201551:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1784403327.201597:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403327.201646:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260851328:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1784403327.298028:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1784403327.309083:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1784403327.842614:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403328.863044:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403329.247770:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260851456:0@lo:400:kworker.0 00000100:00100000:2.0:1784403329.247861:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403329.248069:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260851968:0@lo:400:kworker.0 00000100:00100000:2.0:1784403329.248099:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403329.248125:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784403329.248131:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260851584:0@lo:400:kworker.0 00000100:00100000:2.0:1784403329.248155:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403329.248172:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260852096:0@lo:400:kworker.0 00000100:00100000:2.0:1784403329.248199:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403329.248273:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260851456 00000100:00100000:0.0:1784403329.248281:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260851456 00000100:00100000:0.0:1784403329.248335:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1784403329.248345:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260851456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403329.248397:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260851456:12345-0@lo:400:kworker.0 Request processed in 53us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403329.248405:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1784403329.248455:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260851456:0@lo:400:kworker.0 00000100:00100000:1.0:1784403329.248530:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260852096 00000100:00100000:1.0:1784403329.248535:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260852096 00000100:00100000:1.0:1784403329.248583:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784403329.248591:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260852096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403329.248636:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260852096:12345-0@lo:400:kworker.0 Request processed in 47us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403329.248643:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1784403329.248676:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a73641880 x1871082260852096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403329.248688:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260852096:0@lo:400:kworker.0 00000100:00080000:0.0:1784403329.248895:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403329.249380:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260851712:0@lo:400:kworker.0 00000100:00100000:3.0:1784403329.249420:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403329.249457:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784403329.249466:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260851840:0@lo:400:kworker.0 00000100:00100000:3.0:1784403329.249492:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403329.249528:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260851968 00000100:00100000:3.0:1784403329.249533:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260851968 00000100:00100000:3.0:1784403329.249578:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260851584 00000100:00100000:3.0:1784403329.249582:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260851584 00000100:00100000:3.0:1784403329.249596:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260851712 00000100:00100000:3.0:1784403329.249598:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260851712 00000100:00100000:3.0:1784403329.249612:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784403329.249619:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260851968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403329.249663:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260851968:12345-0@lo:400:kworker.0 Request processed in 43us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403329.249669:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784403329.249684:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784403329.249690:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260851584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403329.249719:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260851584:12345-0@lo:400:kworker.0 Request processed in 29us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403329.249725:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784403329.249736:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784403329.249742:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260851712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403329.249775:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260851712:12345-0@lo:400:kworker.0 Request processed in 33us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403329.249781:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784403329.249813:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260851840 00000100:00100000:3.0:1784403329.249816:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260851840 00000100:00100000:3.0:1784403329.249841:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784403329.249847:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260851840:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784403329.250163:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784403329.250168:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403329.250195:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260851712:0@lo:400:kworker.0 00000100:00100000:1.0:1784403329.250363:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260851584:0@lo:400:kworker.0 00000100:00100000:1.0:1784403329.250375:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260851968:0@lo:400:kworker.0 00000100:00100000:3.0:1784403329.250855:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260851840:12345-0@lo:400:kworker.0 Request processed in 1005us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403329.250900:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784403329.251220:0:3565:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1784403329.251226:0:3565:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a7b5d3480, transno 4294967300 00000100:00100000:0.0:1784403329.251278:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260851840:0@lo:400:kworker.0 00000100:00100000:3.0:1784403329.759111:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784403329.759135:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260852224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403329.759216:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403329.759348:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260852224 00000100:00100000:1.0:1784403329.759358:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260852224 00000100:00100000:1.0:1784403329.759412:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784403329.759422:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260852224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784403329.759459:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403329.759525:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260852224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403329.759549:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1784403329.759680:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77e39f80 x1871082260852224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403329.759700:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260852224:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784403329.887262:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403330.911032:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403331.643726:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403331.643775:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403331.643820:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403331.643858:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403331.643920:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240892928 00000100:00100000:2.0:1784403331.643930:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240892928 00000100:00100000:2.0:1784403331.643991:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:2.0:1784403331.644002:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240892928:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403331.644075:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240892928:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403331.644082:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240892672 00000100:00100000:1.0:1784403331.644088:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240892672 00000100:00100000:2.0:1784403331.644099:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:1.0:1784403331.644124:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 281 00000100:00080000:2.0:1784403331.644125:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403331.644133:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2358:x1871082240892672:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403331.644165:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2358:x1871082240892672:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 34us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403331.644171:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 281 00000100:00100000:3.0:1784403331.644665:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240892800 00000100:00100000:3.0:1784403331.644672:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240892800 00000100:00100000:3.0:1784403331.644725:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240893056 00000100:00100000:3.0:1784403331.644728:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240893056 00000100:00100000:3.0:1784403331.644767:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:3.0:1784403331.644776:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240892800:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403331.644810:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:1.0:1784403331.644821:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2358:x1871082240893056:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403331.644824:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240892800:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 48us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403331.644834:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:1.0:1784403331.644856:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2358:x1871082240893056:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 37us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403331.644887:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00080000:2.0:1784403331.646282:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784403331.935045:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403332.320671:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784403332.320700:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260852352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403332.320785:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403332.320842:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260852352 00000100:00100000:0.0:1784403332.321036:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260852352 00000100:00100000:3.0:1784403332.327388:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784403332.327403:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260852352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784403332.327450:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403332.327550:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260852352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (6764us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403332.327558:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784403332.327627:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260852352:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784403332.327660:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784403332.959122:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403333.983469:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403334.368268:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260852736:0@lo:400:kworker.0 00000100:00100000:2.0:1784403334.368356:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403334.368426:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784403334.368432:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260852864:0@lo:400:kworker.0 00000100:00100000:2.0:1784403334.368459:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403334.368509:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260852864 00000100:00100000:2.0:1784403334.368518:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260852864 00000100:00100000:2.0:1784403334.368574:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784403334.368583:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260852864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403334.368635:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260852864:12345-0@lo:400:kworker.0 Request processed in 53us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403334.368642:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784403334.368680:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260852864:0@lo:400:kworker.0 00000100:00100000:3.0:1784403334.368962:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260852736 00000100:00100000:3.0:1784403334.368979:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260852736 00000100:00100000:3.0:1784403334.369019:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784403334.369027:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260852736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403334.369078:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260852736:12345-0@lo:400:kworker.0 Request processed in 52us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403334.369084:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1784403334.369100:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784403334.369104:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403334.369218:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260852736:0@lo:400:kworker.0 00000100:00100000:0.0:1784403334.369368:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260852608:0@lo:400:kworker.0 00000100:00100000:0.0:1784403334.369401:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403334.369430:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260853120:0@lo:400:kworker.0 00000100:00100000:3.0:1784403334.369453:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260852608 00000100:00100000:0.0:1784403334.369453:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403334.369458:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260852608 00000100:00100000:0.0:1784403334.369487:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784403334.369493:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260852480:0@lo:400:kworker.0 00000100:00100000:0.0:1784403334.369520:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403334.369540:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260852992:0@lo:400:kworker.0 00000100:00100000:2.0:1784403334.369571:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260853120 00000100:00100000:0.0:1784403334.369574:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403334.369575:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260853120 00000100:00100000:2.0:1784403334.369604:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784403334.369610:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260852992 00000100:00100000:2.0:1784403334.369611:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260853120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403334.369613:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260852992 00000100:00100000:3.0:1784403334.369647:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784403334.369656:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260852608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403334.369693:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260852608:12345-0@lo:400:kworker.0 Request processed in 38us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403334.369729:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260853120:12345-0@lo:400:kworker.0 Request processed in 118us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403334.369742:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784403334.369752:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260852608:0@lo:400:kworker.0 00000100:00100000:2.0:1784403334.369761:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260852480 00000100:00100000:2.0:1784403334.369764:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260852480 00010000:00080000:1.0:1784403334.369765:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a72e1a680 x1871082260853120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403334.369775:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260853120:0@lo:400:kworker.0 00000100:00100000:2.0:1784403334.369786:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1784403334.369792:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260852480:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784403334.369802:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784403334.369805:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784403334.369826:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260852480:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403334.369831:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260852480:0@lo:400:kworker.0 00000100:00100000:2.0:1784403334.369833:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1784403334.371672:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784403334.371691:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784403334.371698:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260852992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403334.371889:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260852992:0@lo:400:kworker.0 00000100:00100000:0.0:1784403334.372030:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260852992:12345-0@lo:400:kworker.0 Request processed in 347us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403334.372037:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784403334.879549:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784403334.879574:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260853248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403334.879651:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403334.879905:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260853248 00000100:00100000:1.0:1784403334.879914:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260853248 00000100:00100000:1.0:1784403334.879970:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784403334.879981:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260853248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784403334.880021:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403334.880089:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260853248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403334.880097:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1784403334.880276:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77e38000 x1871082260853248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403334.880296:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260853248:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784403335.007369:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784403335.269602:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784403336.031111:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403336.765098:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403336.765233:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403336.769126:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240893184 00000100:00100000:0.0:1784403336.769150:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240893184 00000100:00100000:0.0:1784403336.769340:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 283 00000100:00100000:0.0:1784403336.769354:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240893184:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403336.769480:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240893184:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 129us (4397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403336.769489:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 283 00000100:00100000:1.0:1784403336.771183:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240893312 00000100:00100000:1.0:1784403336.771202:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240893312 00000100:00100000:1.0:1784403336.771314:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:1.0:1784403336.771330:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240893312:12345-192.168.204.28@tcp:400:kworker.0 00000100:00080000:3.0:1784403336.771345:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784403336.771432:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240893312:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 103us (6195us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403336.771440:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:2.0:1784403336.780391:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403336.786012:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240893440 00000100:00100000:0.0:1784403336.786034:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240893440 00000100:00100000:3.0:1784403336.786157:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403336.786252:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:0.0:1784403336.786269:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2357:x1871082240893440:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:0.0:1784403336.786318:0:7099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa880 00000100:00080000:0.0:1784403336.786331:0:7099:0:(import.c:65:import_set_state_nolock()) ffff8c8a522c2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784403336.786389:0:7099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1784403336.786769:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+2:2357:x1871082240893440:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 503us (6393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403336.786779:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1784403336.786914:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240893568 00000100:00100000:2.0:1784403336.786920:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240893568 00010000:00010000:3.0:1784403336.788353:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784403336.789358:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784403336.789372:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403336.790249:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:2.0:1784403336.790266:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2358:x1871082240893568:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403336.790377:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2358:x1871082240893568:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 115us (4235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403336.790385:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 121 00010000:00010000:1.0:1784403337.056349:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403337.441416:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784403337.441471:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260853376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403337.441572:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403337.444920:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260853376 00000100:00100000:2.0:1784403337.444943:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260853376 00000100:00100000:2.0:1784403337.445040:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784403337.445053:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260853376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403337.445115:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403337.445225:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260853376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (3653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403337.445233:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1784403337.445440:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403337.445499:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260853376:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1784403337.545349:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000020:00000080:1.0:1784403337.545362:0:7124:0:(genops.c:885:class_export_put()) final put ffff8c8a522c3000/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000020:00000080:2.0:1784403337.545531:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a522c3000/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 for lustre-OST0000 00000020:00000080:2.0:1784403337.545595:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a522c2000 for lustre-OST0000 00010000:00010000:3.0:1784403338.079298:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403339.104848:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403339.488071:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260853888:0@lo:400:kworker.0 00000100:00100000:3.0:1784403339.488165:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403339.488410:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260853760:0@lo:400:kworker.0 00000100:00100000:0.0:1784403339.488450:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403339.488503:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260853760 00000100:00100000:0.0:1784403339.488511:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260853760 00000100:00100000:0.0:1784403339.488586:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1784403339.488600:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260853760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403339.488674:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260853760:12345-0@lo:400:kworker.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403339.488681:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1784403339.488722:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403339.488757:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260853760:0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489007:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260853632:0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489046:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403339.489079:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260854144:0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489104:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403339.489133:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784403339.489139:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260853504:0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489169:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403339.489194:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260854016:0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489216:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403339.489260:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260853888 00000100:00100000:2.0:1784403339.489266:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260853888 00000100:00100000:2.0:1784403339.489306:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260854144 00000100:00100000:2.0:1784403339.489310:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260854144 00000100:00100000:2.0:1784403339.489330:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784403339.489338:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260853888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489377:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260853888:12345-0@lo:400:kworker.0 Request processed in 40us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403339.489396:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784403339.489411:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784403339.489417:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260854144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489469:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260854144:12345-0@lo:400:kworker.0 Request processed in 53us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403339.489475:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784403339.489494:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260853504 00000100:00100000:2.0:1784403339.489497:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260853504 00000100:00100000:2.0:1784403339.489519:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1784403339.489525:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260853504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489552:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260853504:12345-0@lo:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403339.489559:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1784403339.489587:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260853632 00000100:00100000:2.0:1784403339.489591:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260853632 00000100:00100000:2.0:1784403339.489622:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260854016 00000100:00100000:2.0:1784403339.489626:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260854016 00000100:00100000:2.0:1784403339.489646:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784403339.489653:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260853632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489697:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260853632:12345-0@lo:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403339.489704:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784403339.489715:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784403339.489721:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260854016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489749:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260854016:12345-0@lo:400:kworker.0 Request processed in 28us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403339.489754:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1784403339.489780:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784403339.489784:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403339.489786:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403339.489814:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260853504:0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489826:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260854016:0@lo:400:kworker.0 00000100:00100000:2.0:1784403339.489835:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260853632:0@lo:400:kworker.0 00010000:00080000:2.0:1784403339.489847:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77cd6d80 x1871082260854144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403339.489857:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260854144:0@lo:400:kworker.0 00000100:00100000:3.0:1784403339.490507:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260853888:0@lo:400:kworker.0 00000100:00100000:0.0:1784403340.003325:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260854272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784403340.003428:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403340.003609:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260854272 00000100:00100000:2.0:1784403340.003620:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260854272 00000100:00100000:2.0:1784403340.003697:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784403340.003709:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260854272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403340.003759:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403340.003821:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260854272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403340.003829:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1784403340.004101:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77e38700 x1871082260854272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403340.004122:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260854272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784403340.127107:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403341.155319:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403341.888837:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403341.888943:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403341.888989:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403341.889085:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240893824 00000100:00100000:0.0:1784403341.889102:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240893952 00000100:00100000:3.0:1784403341.889105:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240893824 00000100:00100000:0.0:1784403341.889115:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240893952 00000100:00100000:1.0:1784403341.889202:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240893696 00000100:00100000:3.0:1784403341.889222:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:1.0:1784403341.889230:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240893696 00000100:00100000:3.0:1784403341.889242:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240893824:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403341.889283:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 285 00000100:00100000:1.0:1784403341.889296:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240893696:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403341.889360:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240893824:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 109us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403341.889363:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240893696:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 68us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403341.889389:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 285 00000100:00100000:3.0:1784403341.889396:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:0.0:1784403341.890487:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:0.0:1784403341.890500:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2359:x1871082240893952:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403341.890598:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2359:x1871082240893952:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 100us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403341.890606:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00080000:2.0:1784403341.893043:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784403342.175782:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403342.559180:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784403342.559211:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260854400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403342.559307:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403342.559386:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260854400 00000100:00100000:2.0:1784403342.559396:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260854400 00000100:00100000:2.0:1784403342.559461:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784403342.559472:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260854400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403342.559546:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403342.559610:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260854400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403342.559618:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1784403342.559643:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403342.559683:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260854400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784403343.202398:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403344.224687:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403344.608924:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260854784:0@lo:400:kworker.0 00000100:00100000:0.0:1784403344.609035:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403344.609133:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784403344.609140:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260854912:0@lo:400:kworker.0 00000100:00100000:0.0:1784403344.609170:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403344.609217:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260854912 00000100:00100000:0.0:1784403344.609227:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260854912 00000100:00100000:0.0:1784403344.609317:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784403344.609328:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260854912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403344.609390:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260854912:12345-0@lo:400:kworker.0 Request processed in 64us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403344.609398:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1784403344.609422:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403344.609462:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260854912:0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.609620:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260854656:0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.609654:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403344.609687:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260855168:0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.609711:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403344.609751:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784403344.609758:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260854528:0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.609788:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403344.609811:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260855040:0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.609833:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403344.609896:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260855168 00000100:00100000:3.0:1784403344.609900:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260855168 00000100:00100000:3.0:1784403344.609937:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784403344.609946:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260855168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.609987:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260855168:12345-0@lo:400:kworker.0 Request processed in 44us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403344.609993:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784403344.610016:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260854528 00000100:00100000:3.0:1784403344.610019:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260854528 00000100:00100000:3.0:1784403344.610057:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1784403344.610063:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260854528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.610094:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260854528:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403344.610100:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1784403344.610130:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260854784 00000100:00100000:3.0:1784403344.610134:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260854784 00000100:00100000:3.0:1784403344.610162:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260854656 00000100:00100000:3.0:1784403344.610165:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260854656 00000100:00100000:3.0:1784403344.610176:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260855040 00000100:00100000:3.0:1784403344.610178:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260855040 00000100:00100000:3.0:1784403344.610193:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784403344.610199:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260854784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.610236:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260854784:12345-0@lo:400:kworker.0 Request processed in 37us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403344.610241:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784403344.610252:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784403344.610258:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260854656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.610283:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260854656:12345-0@lo:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403344.610304:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784403344.610316:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784403344.610323:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260855040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.610350:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260855040:12345-0@lo:400:kworker.0 Request processed in 28us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403344.610355:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1784403344.610382:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784403344.610391:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403344.610413:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260854528:0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.610424:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260855040:0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.610433:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260854656:0@lo:400:kworker.0 00010000:00080000:3.0:1784403344.610445:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7b33b800 x1871082260855168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403344.610456:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260855168:0@lo:400:kworker.0 00000100:00100000:3.0:1784403344.610498:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260854784:0@lo:400:kworker.0 00000100:00100000:3.0:1784403345.119176:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260855296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403345.119263:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403345.119603:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260855296 00000100:00100000:2.0:1784403345.119612:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260855296 00000100:00100000:2.0:1784403345.119668:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784403345.119679:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260855296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403345.119718:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403345.119777:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260855296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403345.119784:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1784403345.119903:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7b339880 x1871082260855296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403345.119923:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260855296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784403345.247426:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784403345.504395:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784403346.271174:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784403346.465207:0:12216:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:35:45 (1784403345) 00000100:00100000:2.0:1784403347.008011:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403347.008064:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403347.008108:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403347.008248:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240894080 00000100:00100000:0.0:1784403347.008272:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240894080 00000100:00100000:0.0:1784403347.008338:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 287 00000100:00100000:0.0:1784403347.008350:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240894080:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403347.008439:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240894080:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 90us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403347.008446:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 287 00000100:00100000:1.0:1784403347.017971:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240894208 00000100:00100000:1.0:1784403347.017987:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240894208 00000100:00100000:1.0:1784403347.018063:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240894336 00000100:00100000:1.0:1784403347.018066:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240894336 00000100:00100000:1.0:1784403347.018101:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 130 00000100:00100000:1.0:1784403347.018111:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240894208:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403347.018288:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 131 00000100:00100000:2.0:1784403347.018298:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240894336:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403347.018376:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240894336:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 80us (10267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403347.018383:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 131 00000100:00100000:1.0:1784403347.018720:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240894208:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 609us (10718us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403347.018727:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 130 00000100:00080000:0.0:1784403347.020525:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784403347.295016:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403347.679229:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784403347.679264:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260855424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784403347.679350:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403347.679751:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260855424 00000100:00100000:2.0:1784403347.679761:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260855424 00000100:00100000:2.0:1784403347.679825:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784403347.679849:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260855424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403347.679910:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403347.679963:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260855424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403347.679970:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1784403347.679990:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403347.680023:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260855424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403348.270500:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403348.273099:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240894464 00000100:00100000:0.0:1784403348.273113:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240894464 00000100:00100000:0.0:1784403348.273321:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:0.0:1784403348.273342:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:10225:x1871082240894464:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784403348.273363:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403348.273399:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afa94b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ead4 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403348.273486:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa952 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403348.273501:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403348.273526:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403348.273749:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784403348.273754:0:6294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403348.273886:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403348.273915:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afa94b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ead4 expref: 7 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403348.273932:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa952 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ead4 expref: 6 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403348.273941:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:0.0:1784403348.273944:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403348.273948:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4c00, rc 0) 00000100:00100000:0.0:1784403348.274027:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:10225:x1871082240894464:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 687us (3538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403348.274034:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:2.0:1784403348.283590:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403348.283947:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240894592 00000100:00100000:1.0:1784403348.283959:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240894592 00000100:00100000:1.0:1784403348.284067:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:1.0:1784403348.284078:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:10226:x1871082240894592:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403348.284126:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403348.284149:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afa959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eadb expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.284241:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa960 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.284258:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.284271:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.284288:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa967 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.284295:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.284301:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.284960:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe800/0x6828175665afa96e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.284972:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe800/0x6828175665afa96e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.284980:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe800/0x6828175665afa96e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403348.285058:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784403348.285066:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403348.285138:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe800/0x6828175665afa96e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285149:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285156:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa960 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285162:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa960 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285168:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403348.285171:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa960 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285178:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa960 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285190:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:1.0:1784403348.285193:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403348.285198:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285204:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285216:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285409:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa967 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285426:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa967 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285431:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403348.285434:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa967 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285440:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa967 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285477:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c8a51bd0300) 00010000:00010000:1.0:1784403348.285480:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403348.285483:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa967 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285488:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa967 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285522:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afa959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eadb expref: 8 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285535:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe800/0x6828175665afa96e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eadb expref: 7 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.285541:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c8a51bd0200) 00010000:00010000:1.0:1784403348.285543:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784403348.285545:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a414fe800, rc 0) 00000100:00100000:1.0:1784403348.285675:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:10226:x1871082240894592:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 1598us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403348.285692:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:2.0:1784403348.295570:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403348.295941:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240894848 00000100:00100000:1.0:1784403348.295952:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240894848 00000100:00100000:1.0:1784403348.296014:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:1.0:1784403348.296024:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:10226:x1871082240894848:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403348.296047:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403348.296067:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afa975 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eae2 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.296148:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa97c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.296170:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa97c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.296185:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa97c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.296569:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa983 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.296578:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa983 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.296587:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa983 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.298365:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe400/0x6828175665afa98a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.298397:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe400/0x6828175665afa98a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.298407:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe400/0x6828175665afa98a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403348.298420:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1784403348.298655:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa97c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299088:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa97c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299095:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa97c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299101:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403348.299104:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa97c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299363:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa97c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299379:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c8a51bd0200) 00010000:00010000:1.0:1784403348.299382:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403348.299387:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa97c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299394:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa97c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299410:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa983 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299425:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa983 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299430:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa983 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299434:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403348.299437:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa983 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299453:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa983 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299462:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c8a51bd0300) 00010000:00010000:1.0:1784403348.299465:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403348.299468:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa983 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403348.299474:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa983 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403348.302052:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afa975 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eae2 expref: 10 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403348.302094:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe400/0x6828175665afa98a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eae2 expref: 9 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403348.302105:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:0.0:1784403348.302109:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403348.302113:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a414fe400, rc 0) 00000100:00100000:0.0:1784403348.302601:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:10226:x1871082240894848:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 6575us (7037us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784403348.302611:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:2.0:1784403348.307353:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403348.307924:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240894976 00000100:00100000:3.0:1784403348.307937:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240894976 00000100:00100000:3.0:1784403348.308045:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:3.0:1784403348.308058:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:10226:x1871082240894976:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784403348.308189:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:10226:x1871082240894976:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 Request processed in 134us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403348.308197:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00010000:00010000:3.0:1784403348.319233:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784403348.579009:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784403349.348814:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403349.727609:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260855552:0@lo:400:kworker.0 00000100:00100000:2.0:1784403349.727692:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403349.727814:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260855552 00000100:00100000:0.0:1784403349.727822:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260855552 00000100:00100000:0.0:1784403349.727896:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1784403349.727907:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260855552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403349.732178:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260855552:12345-0@lo:400:kworker.0 Request processed in 4263us (4476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403349.732194:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1784403349.732318:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260855680:0@lo:400:kworker.0 00000100:00100000:0.0:1784403349.732370:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403349.732411:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260855680 00000100:00100000:0.0:1784403349.732429:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260855680 00000100:00100000:0.0:1784403349.732466:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784403349.732474:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260855680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403349.732525:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260855680:12345-0@lo:400:kworker.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403349.732548:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784403349.732584:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260855680:0@lo:400:kworker.0 00000100:00100000:1.0:1784403349.732684:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784403349.732694:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260855808:0@lo:400:kworker.0 00000100:00100000:1.0:1784403349.732726:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403349.732753:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260855808 00000100:00100000:1.0:1784403349.732757:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260855808 00000100:00100000:1.0:1784403349.732790:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784403349.732796:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260855808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403349.732832:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260855808:12345-0@lo:400:kworker.0 Request processed in 37us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403349.732845:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1784403349.732888:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784403349.732913:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260855808:0@lo:400:kworker.0 00000100:00100000:1.0:1784403349.732954:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260855936:0@lo:400:kworker.0 00000100:00100000:1.0:1784403349.732982:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403349.733012:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260855936 00000100:00100000:1.0:1784403349.733016:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260855936 00000100:00100000:0.0:1784403349.733105:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784403349.733113:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260856064:0@lo:400:kworker.0 00000100:00100000:0.0:1784403349.733137:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403349.733157:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260856064 00000100:00100000:0.0:1784403349.733160:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260856064 00000100:00100000:0.0:1784403349.733183:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784403349.733188:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260856064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403349.733377:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260856064:12345-0@lo:400:kworker.0 Request processed in 187us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403349.733385:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784403349.733415:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260856064:0@lo:400:kworker.0 00000100:00100000:0.0:1784403349.733459:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260856192:0@lo:400:kworker.0 00000100:00100000:0.0:1784403349.733486:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403349.734041:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260856192 00000100:00100000:1.0:1784403349.734048:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260856192 00000100:00100000:1.0:1784403349.734094:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784403349.734104:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260855936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403349.734111:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784403349.734122:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260856192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403349.734186:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260856192:12345-0@lo:400:kworker.0 Request processed in 66us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403349.734193:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1784403349.734223:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784403349.734227:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784403349.734229:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784403349.734251:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a73642a00 x1871082260856192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784403365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403349.734277:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260856192:0@lo:400:kworker.0 00000100:00100000:1.0:1784403349.734654:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260855936:12345-0@lo:400:kworker.0 Request processed in 553us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403349.734662:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784403349.734694:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260855936:0@lo:400:kworker.0 00000100:00100000:2.0:1784403349.736023:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260855552:0@lo:400:kworker.0 00000100:00100000:1.0:1784403350.239205:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784403350.239231:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260856320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403350.239309:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403350.239484:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260856320 00000100:00100000:2.0:1784403350.239493:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260856320 00000100:00100000:2.0:1784403350.239551:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784403350.239561:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260856320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403350.239603:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403350.239650:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260856320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403350.239657:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1784403350.239783:0:3566:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7b33aa00 x1871082260856320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403350.239802:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260856320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784403350.301973:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403350.302093:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240895104 00000100:00100000:1.0:1784403350.302103:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240895104 00000100:00100000:1.0:1784403350.302195:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:1.0:1784403350.302207:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:10268:x1871082240895104:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403350.302236:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403350.302261:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eae9 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302334:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afa99f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302351:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afa99f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302365:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afa99f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302381:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302389:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302396:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302840:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afa99f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302851:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afa99f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302858:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afa99f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302891:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403350.302902:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afa99f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302911:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afa99f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302923:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:1.0:1784403350.302926:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403350.302931:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afa99f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302938:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afa99f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302950:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302956:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302961:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302966:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403350.302970:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302976:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.302983:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c8a51bd0300) 00010000:00010000:1.0:1784403350.302985:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403350.302996:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.303001:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.303038:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa998 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eae9 expref: 10 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.303050:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:1.0:1784403350.303052:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403350.303055:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eae9 expref: 10 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.303064:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a414ff600, rc 0) 00000100:00100000:1.0:1784403350.303126:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:10268:x1871082240895104:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 921us (1164us total) trans 0 rc 301/301 00000100:00100000:1.0:1784403350.303135:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00080000:0.0:1784403350.303966:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403350.315274:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403350.315353:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240895360 00000100:00100000:3.0:1784403350.315363:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240895360 00000100:00100000:3.0:1784403350.315433:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:3.0:1784403350.315444:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:10268:x1871082240895360:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1784403350.315500:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403350.315529:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa952 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ead4 expref: 9 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.315547:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:3.0:1784403350.315560:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784403350.315850:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9ad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.315891:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.315902:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.315916:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.315923:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.315929:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403350.318374:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1784403350.318394:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.318429:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9ad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.318438:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.318445:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403350.318450:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.318459:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9ad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.318479:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403350.318483:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403350.318488:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9ad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.318495:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9ad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784403350.318515:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb410475 reply state 00000000438feddd transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403350.318526:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784403350.318652:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:10268:x1871082240895360:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 3205us (3384us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1784403350.318663:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00010000:00010000:1.0:1784403350.339004:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.339024:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.339033:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.339278:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403350.339283:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.339303:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.339322:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c8a43245a00) 00010000:00010000:1.0:1784403350.339325:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403350.339330:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.339335:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9b4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.369701:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403350.454552:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403350.454616:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240895488 00000100:00100000:1.0:1784403350.454754:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240895488 00000100:00100000:1.0:1784403350.454820:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:1.0:1784403350.454831:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:10276:x1871082240895488:12345-192.168.204.28@tcp:101:lctl.0 00010000:00010000:1.0:1784403350.454860:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403350.454932:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa9bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eaf0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.455010:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.455025:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.455154:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403350.455230:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784403350.455247:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403350.455292:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.455318:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afa9bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaf0 expref: 11 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.455339:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaf0 expref: 10 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.455348:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:1.0:1784403350.455352:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784403350.455355:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a414ff400, rc 0) 00000100:00100000:1.0:1784403350.455431:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:10276:x1871082240895488:12345-192.168.204.28@tcp:101:lctl.0 Request processed in 601us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403350.455440:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:2.0:1784403350.501669:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403350.508054:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240895616 00000100:00100000:0.0:1784403350.508070:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240895616 00000100:00100000:0.0:1784403350.508218:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:0.0:1784403350.508228:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:10282:x1871082240895616:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403350.508249:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403350.508268:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afa9c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eaf7 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508332:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa9d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508347:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508359:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508384:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afa9d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508392:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afa9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508398:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afa9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508555:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afa9de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508578:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afa9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508586:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afa9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403350.508620:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1784403350.508624:0:6292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403350.508664:0:6292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afa9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508675:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508682:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa9d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508688:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508694:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403350.508698:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508705:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa9d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508717:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:0.0:1784403350.508720:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403350.508726:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa9d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508743:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afa9d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508758:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afa9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508763:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afa9d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508768:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afa9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508772:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403350.508775:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afa9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508780:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afa9d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508787:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c8a4884dc00) 00010000:00010000:0.0:1784403350.508790:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403350.508793:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afa9d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508799:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afa9d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508828:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afa9c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaf7 expref: 12 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508840:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afa9de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaf7 expref: 11 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.508853:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403350.508856:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784403350.508858:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5e00, rc 0) 00000100:00100000:0.0:1784403350.509198:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:10282:x1871082240895616:12345-192.168.204.28@tcp:101:bash.0 Request processed in 970us (7541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403350.509207:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:2.0:1784403350.523589:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403350.523719:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240895872 00000100:00100000:3.0:1784403350.523730:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240895872 00000100:00100000:3.0:1784403350.523809:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:3.0:1784403350.523820:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:10282:x1871082240895872:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403350.523842:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403350.523890:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eafe expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.524367:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.524384:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.524395:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.524466:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.524475:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.524482:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784403350.527306:0:10011:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1784403350.527560:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527578:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527593:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527648:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527656:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527662:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527668:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403350.527673:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527680:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527692:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:3.0:1784403350.527695:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403350.527699:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527705:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afa9ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784403350.527719:0:10011:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000514ea0bf reply state 000000009375a345 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403350.527729:0:10011:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784403350.527768:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afa9e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eafe expref: 14 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527794:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eafe expref: 13 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.527802:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a43245400) 00010000:00010000:3.0:1784403350.527804:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403350.527806:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403350.528636:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:10282:x1871082240895872:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4812us (5053us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1784403350.528646:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:2.0:1784403350.534343:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1784403350.534451:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.534466:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.534474:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.534480:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403350.534485:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.534491:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.534509:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a43245d00) 00010000:00010000:0.0:1784403350.534512:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403350.534517:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.534523:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afa9f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403350.535431:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240896000 00000100:00100000:3.0:1784403350.535442:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240896000 00000100:00100000:3.0:1784403350.535491:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:3.0:1784403350.535597:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1871082240896000:12345-192.168.204.28@tcp:8:bash.0 00010000:00080000:3.0:1784403350.535637:0:7101:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:3.0:1784403350.535672:0:7101:0:(genops.c:1385:class_connect()) connect: client becd6ccb-dd35-46e6-9ecf-44ee31a105f1, cookie 0x6828175665afaa08 00002000:00100000:3.0:1784403350.535691:0:7101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli becd6ccb-dd35-46e6-9ecf-44ee31a105f1/ffff8c8a7b609800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784403350.535703:0:7101:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784403350.536122:0:7101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784403350.536158:0:7101:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b608800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784403350.536316:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2357:x1871082240896000:12345-192.168.204.28@tcp:8:bash.0 Request processed in 815us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403350.536322:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:2.0:1784403350.538731:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403350.538989:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240896128 00000100:00100000:3.0:1784403350.538997:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240896128 00000100:00100000:3.0:1784403350.539104:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:3.0:1784403350.539114:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:0:x1871082240896128:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403350.539130:0:7099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403350.539153:0:7099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f472cc9/0x6828175665afaa0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb05 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784403350.539180:0:7099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403350.539197:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1784403350.539201:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403350.539211:0:7099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f472cc9/0x6828175665afaa0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb05 expref: 7 pid: 7099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.539231:0:7099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f472cc9/0x6828175665afaa0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb05 expref: 7 pid: 7099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.539249:0:7099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6600, rc 0) 00000100:00100000:3.0:1784403350.539301:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:0:x1871082240896128:12345-192.168.204.28@tcp:101:bash.0 Request processed in 189us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403350.539308:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00080000:0.0:1784403350.539768:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784403350.542450:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403350.542742:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240896256 00000100:00100000:0.0:1784403350.542755:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240896256 00000100:00100000:0.0:1784403350.542855:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:0.0:1784403350.542903:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:10282:x1871082240896256:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403350.542926:0:7102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403350.542949:0:7102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb0c expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.542981:0:7102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f472cc9/0x6828175665afaa0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb05 expref: 8 pid: 7099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.542991:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403350.542996:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403350.543001:0:7102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 8 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.543037:0:7102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f472cc9/0x6828175665afaa0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb05 expref: 8 pid: 7099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.543050:0:7102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f472cc9/0x6828175665afaa0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb05 expref: 8 pid: 7099 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403350.543065:0:7102:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73642a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7102:1871082260856448:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403350.543168:0:7102:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a51c71e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784403350.545826:0:7102:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73642a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7102:1871082260856448:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403350.545896:0:7102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 8 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.545928:0:7102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5000, rc 0) 00000100:00100000:0.0:1784403350.545994:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:10282:x1871082240896256:12345-192.168.204.28@tcp:101:bash.0 Request processed in 3128us (3555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403350.546005:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:3.0:1784403350.546805:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403350.546898:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240896384 00000100:00100000:1.0:1784403350.546907:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240896384 00010000:00010000:1.0:1784403350.546966:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f472cc9/0x6828175665afaa0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb05 expref: 8 pid: 7099 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403350.547009:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:1.0:1784403350.547020:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2361:x1871082240896384:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403350.547655:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403350.547683:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f472cc9/0x6828175665afaa0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb05 expref: 8 pid: 7099 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.547811:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f472cc9/0x6828175665afaa0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb05 expref: 8 pid: 7099 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.547850:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f472cc9/0x6828175665afaa0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb05 expref: 8 pid: 7099 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.547996:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403350.548002:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403350.548011:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 7 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.548023:0:6278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 7 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.548254:0:6278:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 7 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403350.548271:0:6278:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6278:1871082260856576:192.168.204.28@tcp:105: 00000100:00100000:1.0:1784403350.548347:0:6278:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac900 going to sleep for 11 seconds 00000100:00100000:3.0:1784403350.551807:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403350.552415:0:6278:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6278:1871082260856576:192.168.204.28@tcp:105: 00010000:00010000:1.0:1784403350.552443:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403350.552521:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240896384:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 5503us (5717us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403350.552532:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:2.0:1784403350.554178:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240896640 00000100:00100000:2.0:1784403350.554195:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240896640 00000100:00100000:2.0:1784403350.554263:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:2.0:1784403350.554274:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:10282:x1871082240896640:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1784403350.554704:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:10282:x1871082240896640:12345-192.168.204.28@tcp:35:bash.0 Request processed in 430us (2904us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1784403350.554713:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:3.0:1784403350.638591:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403350.640448:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240896896 00000100:00100000:0.0:1784403350.640600:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240896896 00000100:00100000:0.0:1784403350.640797:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:0.0:1784403350.640810:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:10292:x1871082240896896:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403350.640846:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403350.640896:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaa1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb13 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403350.641044:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1784403350.641199:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaa1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb13 expref: 16 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.641217:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:0.0:1784403350.641220:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784403350.641225:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaa1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb13 expref: 16 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.641242:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4200, rc 0) 00000100:00100000:0.0:1784403350.641320:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:10292:x1871082240896896:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 513us (2740us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1784403350.641350:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:3.0:1784403350.656654:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403350.657337:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240897152 00000100:00100000:1.0:1784403350.657689:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240897152 00000100:00100000:1.0:1784403350.657830:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:1.0:1784403350.657857:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:10292:x1871082240897152:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403350.658251:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:10292:x1871082240897152:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 395us (1607us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1784403350.658260:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:3.0:1784403350.771685:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403350.775046:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240897280 00000100:00100000:0.0:1784403350.775064:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240897280 00000100:00100000:0.0:1784403350.775421:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:0.0:1784403350.775433:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:10298:x1871082240897280:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403350.775462:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403350.775495:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaa2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb1a expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.775567:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaa32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.775582:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaa32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.775593:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaa32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403350.776006:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1784403350.776012:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403350.776040:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaa32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.776068:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaa2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb1a expref: 18 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.776088:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaa32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb1a expref: 17 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.776128:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403350.776131:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403350.776135:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4c00, rc 0) 00000100:00100000:0.0:1784403350.778772:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:10298:x1871082240897280:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3330us (7092us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403350.778785:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:3.0:1784403350.791169:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403350.792408:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240897536 00000100:00100000:2.0:1784403350.792424:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240897536 00000100:00100000:2.0:1784403350.792515:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:2.0:1784403350.792526:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:10298:x1871082240897536:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403350.792549:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403350.792572:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaa39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb21 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.792686:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.792702:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.792714:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403350.792725:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784403350.792939:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaa39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb21 expref: 20 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.792970:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb21 expref: 19 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.792978:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a43245400) 00010000:00010000:2.0:1784403350.792981:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784403350.792985:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3e00, rc 0) 00000100:00100000:2.0:1784403350.793067:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:10298:x1871082240897536:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 542us (1914us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1784403350.793076:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:3.0:1784403350.807509:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403350.807566:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403350.807684:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240897920 00000100:00100000:0.0:1784403350.807699:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240897920 00000100:00100000:0.0:1784403350.807779:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:0.0:1784403350.807791:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:10298:x1871082240897920:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403350.807816:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403350.807836:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaa4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb28 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.807999:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaa55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.808014:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaa55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.808038:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaa55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403350.808052:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784403350.808180:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaa4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb28 expref: 22 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.808218:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaa55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb28 expref: 21 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.808227:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a43245400) 00010000:00010000:0.0:1784403350.808230:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784403350.808233:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5200, rc 0) 00000100:00100000:0.0:1784403350.808306:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:10298:x1871082240897920:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 517us (739us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784403350.808314:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:2.0:1784403350.808739:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240897664 00000100:00100000:2.0:1784403350.808747:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240897664 00000100:00100000:2.0:1784403350.808799:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:2.0:1784403350.808809:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:2359:x1871082240897664:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403350.808821:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403350.808838:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb21 expref: 21 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.808851:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a43245400) 00010000:00010000:2.0:1784403350.808855:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403350.808923:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:2359:x1871082240897664:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 116us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403350.808931:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:3.0:1784403350.842327:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403350.842470:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240898048 00000100:00100000:0.0:1784403350.842486:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240898048 00000100:00100000:0.0:1784403350.843015:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:0.0:1784403350.843028:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240898048:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:0.0:1784403350.843077:0:7099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.843101:0:7099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 7 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.843110:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403350.843114:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403350.843129:0:7099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.843286:0:7099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 7 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.843319:0:7099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 7 pid: 7102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403350.843336:0:7099:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73642a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7099:1871082260856704:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403350.843473:0:7099:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a51c71a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784403350.851104:0:7099:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73642a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7099:1871082260856704:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403350.851107:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1784403350.851538:0:7099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403350.854235:0:7105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240898176 00000100:00100000:1.0:1784403350.854256:0:7105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240898176 00002000:00100000:1.0:1784403350.854327:0:7105:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8c8a7b626680 x1871082240898176/t0(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:121/0 lens 504/0 e 0 to 0 dl 1784403361 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784403350.854340:0:7105:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a7b626680 with x1871082240898176 ext(0->12) 00010000:00010000:1.0:1784403350.854350:0:7105:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 8 pid: 7102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.854370:0:7105:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 8 pid: 7102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784403350.854378:0:7105:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c8a7b626680 00000100:00100000:1.0:1784403350.854694:0:7105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:1.0:1784403350.854706:0:7105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240898176:12345-192.168.204.28@tcp:4:lfs.0 00000001:00100000:1.0:1784403350.939083:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000100:00100000:3.0:1784403350.939948:0:7105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2360:x1871082240898176:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 85237us (88853us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784403350.939966:0:7105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00002000:00100000:3.0:1784403350.939979:0:7105:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8c8a7b626680 x1871082240898176/t4294967299(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:121/0 lens 504/448 e 0 to 0 dl 1784403361 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784403350.939989:0:7105:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a7b626680 with x1871082240898176 ext(0->12) 00010000:00010000:3.0:1784403350.940000:0:7105:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 9 pid: 7102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403350.940019:0:7105:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 9 pid: 7102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784403350.940329:0:7105:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c8a7b626680 00000100:00100000:3.0:1784403350.944362:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403350.944729:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240898304 00000100:00100000:1.0:1784403350.944740:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240898304 00010000:00010000:1.0:1784403350.944784:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 9 pid: 7102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403350.944974:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:2.0:1784403350.944989:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2360:x1871082240898304:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403350.945024:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784403350.945044:0:6277:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784403350.945048:0:6277:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784403350 00002000:00010000:2.0:1784403350.945050:0:6277:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1784403351 00002000:00010000:2.0:1784403350.945053:0:6277:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784403350 00010000:00010000:2.0:1784403350.945060:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 9 pid: 7102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.945075:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 9 pid: 7102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.945101:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea2d1d7f/0x6828175665afaa16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb0c expref: 9 pid: 7102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.945120:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784403350.945125:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784403350.945131:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.945142:0:6277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.945274:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403350.945337:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240898304:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 351us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403350.945346:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00010000:00010000:0.0:1784403350.946858:0:7099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.946957:0:7099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.946995:0:7099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.947003:0:7099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.947011:0:7099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.947036:0:7099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4200 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403350.947042:0:7099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.947050:0:7099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.947069:0:7099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.947076:0:7099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afaa63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403350.947267:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240898048:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 104238us (104951us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403350.947277:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:3.0:1784403350.952133:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403350.952317:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240898560 00000100:00100000:2.0:1784403350.952338:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240898560 00000100:00100000:2.0:1784403350.952426:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:2.0:1784403350.952437:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:10298:x1871082240898560:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:2.0:1784403350.952508:0:6295:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaa55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb28 expref: 20 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784403350.952827:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1784403350.952932:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1784403350.953609:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1784403350.953671:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.953688:0:6295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eafe expref: 24 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.953698:0:6295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.953734:0:6295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eafe expref: 24 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403350.953750:0:6295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eafe expref: 24 pid: 10011 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403350.953766:0:6295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b339880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6295:1871082260856832:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403350.953862:0:6295:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43e28480 going to sleep for 11 seconds 00000100:00100000:1.0:1784403350.961061:0:6295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b339880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6295:1871082260856832:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403350.964856:0:6295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403350.965208:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403350.969361:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240898688 00000100:00100000:0.0:1784403350.969378:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240898688 00010000:00010000:0.0:1784403350.969441:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eafe expref: 25 pid: 10011 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403350.969491:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:0.0:1784403350.969510:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+25:2360:x1871082240898688:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403350.969529:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403350.969536:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eafe expref: 25 pid: 10011 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.969567:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eafe expref: 25 pid: 10011 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.969590:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afa9fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eafe expref: 25 pid: 10011 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.969608:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a43245400) 00010000:00010000:0.0:1784403350.969740:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.969751:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.969759:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.969785:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403350.969854:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:2360:x1871082240898688:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 354us (4650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403350.969861:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00010000:00010000:1.0:1784403350.969994:0:6295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.970003:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403350.970142:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1784403350.970723:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1784403350.970858:0:6295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260856960:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784403350.970950:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403350.970982:0:6295:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403350.972200:0:6297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260856960 00000100:00100000:0.0:1784403350.972214:0:6297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260856960 00000100:00100000:0.0:1784403350.972270:0:6297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784403350.972280:0:6297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6295:x1871082260856960:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784403350.972404:0:6297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6295:x1871082260856960:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403350.972411:0:6297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784403350.973052:0:6295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260856960:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784403350.974032:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1784403350.974114:0:6295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260857088:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784403350.974189:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403350.974218:0:6295:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac300 going to sleep for 11 seconds 00000100:00100000:0.0:1784403350.974448:0:6297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260857088 00000100:00100000:0.0:1784403350.974455:0:6297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260857088 00000100:00100000:0.0:1784403350.974521:0:6297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403350.974531:0:6297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6295:x1871082260857088:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784403350.975303:0:6297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6295:x1871082260857088:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 771us (1111us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784403350.975312:0:6297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784403350.975663:0:6295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7751c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260857088:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784403350.975732:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1784403350.975776:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.975786:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.975794:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.975814:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403350.975819:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.975827:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.975843:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a43245400) 00010000:00010000:1.0:1784403350.975846:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784403350.975851:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403350.975857:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaa6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784403350.976074:0:6295:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784403350.976812:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1784403350.976826:0:6295:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356544959769ns, next at 357544957250ns, rc = 0 00000001:00080000:1.0:1784403350.976836:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1784403350.976907:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a43245400) 00010000:00010000:1.0:1784403350.976911:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784403350.976919:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaa55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb28 expref: 28 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403350.977163:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:10298:x1871082240898560:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 24727us (27302us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1784403350.977180:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000020:00080000:1.0:1784403350.977186:0:6295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784403350.982437:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403350.987540:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240898816 00000100:00100000:0.0:1784403350.987557:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240898816 00000100:00100000:0.0:1784403350.987816:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:0.0:1784403350.987828:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:10298:x1871082240898816:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403350.987851:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403350.987892:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afaa71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb2f expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.987950:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afaa71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb2f expref: 28 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.987966:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afaa71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb2f expref: 28 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403350.987984:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:0.0:1784403350.987987:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784403350.987991:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5600, rc 0) 00000100:00100000:0.0:1784403350.988062:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:10298:x1871082240898816:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 236us (5639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403350.988069:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:2.0:1784403350.993014:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403350.993251:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240899072 00000100:00100000:3.0:1784403350.993261:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240899072 00000100:00100000:3.0:1784403350.993414:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:3.0:1784403350.993425:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:10298:x1871082240899072:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1784403350.993682:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:10298:x1871082240899072:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 259us (676us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1784403350.993690:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:2.0:1784403351.090608:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403351.092104:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240899328 00000100:00100000:0.0:1784403351.092129:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240899328 00000100:00100000:0.0:1784403351.092209:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:0.0:1784403351.092221:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:10308:x1871082240899328:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403351.092246:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403351.092269:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaa78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb36 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403351.092403:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1784403351.092535:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaa78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb36 expref: 31 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.092551:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:0.0:1784403351.092554:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784403351.092559:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaa78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb36 expref: 31 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.092575:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4600, rc 0) 00000100:00100000:0.0:1784403351.092650:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+30:10308:x1871082240899328:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 430us (2051us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1784403351.092658:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:2.0:1784403351.097972:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403351.098100:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240899456 00000100:00100000:3.0:1784403351.098121:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240899456 00000100:00100000:3.0:1784403351.098189:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:3.0:1784403351.098198:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+30:10308:x1871082240899456:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:3.0:1784403351.098278:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaa86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098295:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaa86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098309:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaa86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098325:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaa8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098331:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaa8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098337:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaa8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098474:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098483:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098490:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784403351.098550:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098564:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaa86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098578:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaa86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098585:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaa86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098593:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403351.098598:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaa86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098606:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaa86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098618:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:3.0:1784403351.098621:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403351.098625:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaa86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098632:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaa86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098646:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaa8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098651:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaa8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098658:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaa8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098663:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403351.098671:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaa8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098677:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaa8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098684:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a43245b00) 00010000:00010000:3.0:1784403351.098686:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403351.098688:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaa8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098694:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaa8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098709:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098715:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098722:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098726:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403351.098729:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098734:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098740:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:3.0:1784403351.098742:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403351.098748:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.098754:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaa94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403351.098823:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+30:10308:x1871082240899456:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 626us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403351.098831:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:2.0:1784403351.107167:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403351.110808:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240899712 00000100:00100000:3.0:1784403351.110822:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240899712 00000100:00100000:3.0:1784403351.110907:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1784403351.110918:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+30:10308:x1871082240899712:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1784403351.111174:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:10308:x1871082240899712:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 257us (4015us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1784403351.111183:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:2.0:1784403351.163809:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403351.164076:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240899968 00000100:00100000:0.0:1784403351.164086:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240899968 00000100:00100000:0.0:1784403351.164163:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:0.0:1784403351.164276:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:10311:x1871082240899968:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403351.164318:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403351.164342:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaa9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb3d expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.164441:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afaaa2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.164455:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afaaa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.164599:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afaaa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.164620:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaaa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.164628:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.164636:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.164760:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.164769:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.164777:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403351.164787:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784403351.165260:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afaaa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165282:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afaaa2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165289:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afaaa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165296:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403351.165300:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afaaa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165309:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afaaa2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165322:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403351.165325:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403351.165329:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afaaa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165336:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afaaa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165350:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165357:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaaa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165363:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaaa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165369:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403351.165380:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaaa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165387:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaaa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165407:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a4884d400) 00010000:00010000:0.0:1784403351.165409:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403351.165412:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaaa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165417:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaaa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165816:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaa9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb3d expref: 34 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165838:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb3d expref: 33 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.165846:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:0.0:1784403351.165848:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403351.165851:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4400, rc 0) 00000100:00100000:0.0:1784403351.166043:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+33:10311:x1871082240899968:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1870us (2242us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1784403351.166053:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:2.0:1784403351.168935:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403351.169349:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240900096 00000100:00100000:3.0:1784403351.169359:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240900096 00000100:00100000:3.0:1784403351.169430:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:3.0:1784403351.169440:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+33:10311:x1871082240900096:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:3.0:1784403351.169776:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaabe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.169794:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaabe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.169807:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaabe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.169834:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaabe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.169855:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaabe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.169861:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaabe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.170270:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403351.170275:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaabe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.170283:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaabe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.170296:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:3.0:1784403351.170298:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403351.170303:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaabe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.170309:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaabe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403351.170388:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+33:10311:x1871082240900096:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 948us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403351.170407:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:3.0:1784403351.173909:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403351.174061:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240900352 00000100:00100000:1.0:1784403351.174071:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240900352 00000100:00100000:1.0:1784403351.174138:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:1.0:1784403351.174149:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+33:10311:x1871082240900352:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403351.174419:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:10311:x1871082240900352:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 270us (519us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1784403351.174427:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00010000:00010000:3.0:1784403351.391528:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403351.452462:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403351.452585:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240900608 00000100:00100000:1.0:1784403351.452596:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240900608 00000100:00100000:1.0:1784403351.452706:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:1.0:1784403351.452717:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:10342:x1871082240900608:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:1.0:1784403351.452744:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403351.452767:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afaac5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb44 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.452908:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afaacc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.452923:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afaacc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.452936:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afaacc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403351.452947:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784403351.453092:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afaac5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb44 expref: 37 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.453111:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afaacc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb44 expref: 36 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.453131:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:1.0:1784403351.453133:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403351.453137:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a414fe600, rc 0) 00000100:00100000:1.0:1784403351.453208:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:10342:x1871082240900608:12345-192.168.204.28@tcp:101:cat.0 Request processed in 492us (754us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1784403351.453335:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:2.0:1784403351.458979:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403351.459128:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240900736 00000100:00100000:3.0:1784403351.459140:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240900736 00000100:00100000:3.0:1784403351.459237:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:3.0:1784403351.459250:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:2359:x1871082240900736:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403351.459279:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403351.459305:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afaacc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb44 expref: 36 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.459326:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:3.0:1784403351.459332:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403351.459405:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+35:2359:x1871082240900736:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 158us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403351.459413:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:3.0:1784403351.463959:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403351.464137:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240900992 00000100:00100000:1.0:1784403351.464147:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240900992 00000100:00100000:1.0:1784403351.464377:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1784403351.464397:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+35:10342:x1871082240900992:12345-192.168.204.28@tcp:35:cat.0 00000100:00100000:1.0:1784403351.466049:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:10342:x1871082240900992:12345-192.168.204.28@tcp:35:cat.0 Request processed in 1656us (2093us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1784403351.466061:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:3.0:1784403351.550755:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403351.551417:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240901248 00000100:00100000:0.0:1784403351.551427:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240901248 00000100:00100000:0.0:1784403351.551493:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:0.0:1784403351.551505:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:10348:x1871082240901248:12345-192.168.204.28@tcp:101:dd.0 00010000:00010000:0.0:1784403351.551550:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403351.551554:0:6292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784403351.551596:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaa32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb1a expref: 36 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.551628:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403351.551634:0:6292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403351.551647:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaada lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb4b expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.551757:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.551772:0:6292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb3d expref: 36 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.551780:0:6292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.551817:0:6292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb3d expref: 36 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.551831:0:6292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb3d expref: 36 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403351.551845:0:6292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73642a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6292:1871082260857216:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403351.552180:0:6292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a51b15480 going to sleep for 11 seconds 00000100:00100000:2.0:1784403351.557958:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403351.558056:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240901376 00000100:00100000:1.0:1784403351.558065:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240901376 00000100:00100000:0.0:1784403351.558081:0:6292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73642a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6292:1871082260857216:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403351.558109:0:6292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.558113:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb3d expref: 37 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403351.558152:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:1.0:1784403351.558162:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+37:2361:x1871082240901376:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403351.558178:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403351.558186:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb3d expref: 37 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.558824:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb3d expref: 37 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.558860:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaab0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb3d expref: 37 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.558907:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:1.0:1784403351.558912:0:6277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.558922:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.558929:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.559005:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403351.559063:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:2361:x1871082240901376:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 901us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403351.559072:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00010000:00010000:0.0:1784403351.560543:0:6292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.560558:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403351.560583:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784403351.560833:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaada lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb4b expref: 37 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.560854:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb4b expref: 36 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.560861:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:0.0:1784403351.561003:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784403351.561007:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5400, rc 0) 00000100:00100000:0.0:1784403351.561171:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:10348:x1871082240901248:12345-192.168.204.28@tcp:101:dd.0 Request processed in 9660us (10418us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1784403351.561182:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:2.0:1784403351.567933:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403351.568022:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240901632 00000100:00100000:0.0:1784403351.568033:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240901632 00000100:00100000:0.0:1784403351.568097:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:0.0:1784403351.568108:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:10348:x1871082240901632:12345-192.168.204.28@tcp:36:dd.0 00010000:00010000:0.0:1784403351.568860:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.568915:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.568942:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784403351.568990:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1784403351.569016:0:10011:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009597646 reply state 0000000042292cc9 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403351.569025:0:10011:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784403351.569889:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+39:10348:x1871082240901632:12345-192.168.204.28@tcp:36:dd.0 Request processed in 1756us (1940us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1784403351.569900:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000020:00080000:0.0:1784403351.569907:0:10011:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784403351.575735:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.575754:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.575762:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.575768:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403351.575772:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.575779:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.575797:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:3.0:1784403351.575800:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403351.575820:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.575826:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaaef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403351.907073:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403351.907175:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240901760 00000100:00100000:3.0:1784403351.907185:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240901760 00000100:00100000:3.0:1784403351.907271:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:3.0:1784403351.907282:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+38:10362:x1871082240901760:12345-192.168.204.28@tcp:101:stat.0 00010000:00010000:3.0:1784403351.907309:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403351.907337:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaaf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb52 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907430:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaafd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907448:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaafd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907460:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaafd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907666:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afab04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907675:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afab04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907682:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afab04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907810:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907821:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb4b expref: 39 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907830:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907903:0:6294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb4b expref: 39 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403351.907917:0:6294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb4b expref: 39 pid: 6292 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403351.907931:0:6294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b625f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260857344:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403351.908067:0:6294:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a51bd3180 going to sleep for 11 seconds 00000100:00100000:1.0:1784403351.914838:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403351.915056:0:6294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b625f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260857344:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403351.915100:0:6294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403351.915904:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240902016 00000100:00100000:2.0:1784403351.915915:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240902016 00000100:00100000:2.0:1784403351.916044:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:2.0:1784403351.916055:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:5573:x1871082240902016:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784403351.916474:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+41:5573:x1871082240902016:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 419us (1645us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1784403351.916483:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:2.0:1784403351.925073:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403351.925527:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240902144 00000100:00100000:0.0:1784403351.925538:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240902144 00010000:00010000:0.0:1784403351.925591:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb4b expref: 41 pid: 6292 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403351.925653:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:0.0:1784403351.925665:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+41:2361:x1871082240902144:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403351.925683:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403351.925691:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb4b expref: 41 pid: 6292 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.925705:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb4b expref: 41 pid: 6292 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.925730:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afaae1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb4b expref: 41 pid: 6292 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.925781:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:0.0:1784403351.925787:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.925799:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.925808:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403351.925855:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403351.925972:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:2361:x1871082240902144:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 308us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403351.925980:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00010000:00010000:1.0:1784403351.926640:0:6294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.926651:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403351.926716:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784403351.926721:0:6294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403351.926765:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.926779:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.926801:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaafd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.926808:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaafd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.926816:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaafd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.926823:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403351.926829:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaafd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.926836:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaafd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.926851:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:1.0:1784403351.926853:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403351.926857:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaafd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.927810:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaafd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.927839:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afab04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.927846:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afab04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.927853:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afab04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.927974:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403351.927978:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afab04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.927986:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afab04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.927999:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a43245b00) 00010000:00010000:1.0:1784403351.928002:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403351.928006:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afab04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.928012:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afab04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.928065:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afaaf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb52 expref: 40 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.928150:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb52 expref: 39 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.928275:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:1.0:1784403351.928278:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403351.928280:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6800, rc 0) 00000100:00100000:1.0:1784403351.928413:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+39:10362:x1871082240901760:12345-192.168.204.28@tcp:101:stat.0 Request processed in 21130us (21348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403351.928423:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:2.0:1784403351.982699:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403351.982850:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240902400 00000100:00100000:1.0:1784403351.982948:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240902400 00000100:00100000:1.0:1784403351.983016:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:1.0:1784403351.983037:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+39:10368:x1871082240902400:12345-192.168.204.28@tcp:36:truncate.0 00010000:00010000:1.0:1784403351.983101:0:6293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403351.983131:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb52 expref: 39 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.983163:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:1.0:1784403351.983169:0:6293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784403351.983412:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.983713:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.983727:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403351.983788:0:6293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1784403351.983815:0:6293:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f483957 reply state 00000000cbec6b1a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403351.983825:0:6293:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784403351.984349:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+41:10368:x1871082240902400:12345-192.168.204.28@tcp:36:truncate.0 Request processed in 1311us (1658us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1784403351.984358:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 54 00000020:00080000:1.0:1784403351.984364:0:6293:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784403351.989411:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.990201:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.990236:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.990243:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ffc00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403351.990250:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.990260:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.990280:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:1.0:1784403351.990283:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403351.990290:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403351.990297:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403352.131272:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403352.131318:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403352.131642:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403352.131747:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240902656 00000100:00100000:3.0:1784403352.131767:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240902656 00000100:00100000:0.0:1784403352.131901:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240902528 00000100:00100000:0.0:1784403352.131913:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240902528 00000100:00100000:3.0:1784403352.131931:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:3.0:1784403352.131947:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240902656:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403352.131975:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 289 00000100:00100000:0.0:1784403352.131987:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240902528:12345-192.168.204.28@tcp:400:kworker.0 00000100:00080000:2.0:1784403352.132114:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784403352.132251:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240902784 00000100:00100000:1.0:1784403352.132258:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240902784 00000100:00100000:1.0:1784403352.132317:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 135 00000100:00100000:1.0:1784403352.132326:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240902784:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403352.132341:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240902656:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 123us (424us total) trans 0 rc 0/0 00000100:00080000:2.0:1784403352.132429:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403352.132694:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:0.0:1784403352.139919:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240902528:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 7916us (8640us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403352.139937:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 289 00000100:00100000:1.0:1784403352.140845:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240902784:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 8513us (9519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403352.140859:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 135 00000100:00100000:3.0:1784403352.183743:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403352.184063:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240902912 00000100:00100000:0.0:1784403352.184077:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240902912 00000100:00100000:0.0:1784403352.184182:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:0.0:1784403352.184194:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:10383:x1871082240902912:12345-192.168.204.28@tcp:101:stat.0 00010000:00010000:0.0:1784403352.184224:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403352.184269:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afab19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb59 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184362:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184392:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184405:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184420:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184426:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184431:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184548:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184556:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184564:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403352.184685:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1784403352.184691:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403352.184723:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184745:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184754:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184760:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184767:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184774:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403352.184779:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184788:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184802:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403352.184806:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403352.184811:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184818:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184835:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184841:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184857:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184863:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403352.184915:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184922:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184931:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a4884d400) 00010000:00010000:0.0:1784403352.184933:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403352.184936:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184942:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184979:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afab19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb59 expref: 42 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.184994:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb59 expref: 41 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.185002:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:0.0:1784403352.185004:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403352.185006:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5800, rc 0) 00000100:00100000:0.0:1784403352.185084:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+41:10383:x1871082240902912:12345-192.168.204.28@tcp:101:stat.0 Request processed in 891us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403352.185100:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00080000:2.0:1784403352.186240:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403352.296944:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403352.297343:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240903168 00000100:00100000:3.0:1784403352.297355:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240903168 00000100:00100000:3.0:1784403352.297447:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:3.0:1784403352.297460:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+41:10393:x1871082240903168:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403352.297500:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403352.297528:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb60 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403352.297709:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1784403352.297916:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb60 expref: 43 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.297935:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:3.0:1784403352.297939:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403352.297945:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb60 expref: 43 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.297964:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403352.298474:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+42:10393:x1871082240903168:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1012us (1541us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1784403352.298485:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:0.0:1784403352.305135:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403352.305393:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240903424 00000100:00100000:1.0:1784403352.305406:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240903424 00000100:00100000:1.0:1784403352.305492:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:1.0:1784403352.305507:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+42:10393:x1871082240903424:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403352.305926:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+43:10393:x1871082240903424:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 422us (805us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1784403352.305935:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1784403352.380637:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403352.380934:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240903680 00000100:00100000:0.0:1784403352.380948:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240903680 00000100:00100000:0.0:1784403352.381052:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:0.0:1784403352.381064:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+43:10399:x1871082240903680:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403352.381099:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403352.381127:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab43 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb67 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.381420:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.381441:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb59 expref: 44 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.381450:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.381812:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb59 expref: 44 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.381833:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb59 expref: 44 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403352.381851:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73643100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260857472:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403352.382080:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a51b15f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784403352.392846:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73643100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260857472:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403352.392919:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403352.396788:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403352.398138:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240903808 00000100:00100000:1.0:1784403352.398152:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240903808 00010000:00010000:1.0:1784403352.398198:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb59 expref: 45 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403352.398353:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:1.0:1784403352.398365:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+45:2359:x1871082240903808:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403352.398393:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403352.398400:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb59 expref: 45 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.398689:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb59 expref: 45 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.398715:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afab2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb59 expref: 45 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.398733:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:1.0:1784403352.398738:0:6277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.398748:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.398755:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.399019:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403352.399243:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+44:2359:x1871082240903808:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 878us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403352.399253:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 40 00010000:00010000:3.0:1784403352.399616:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.399627:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403352.399648:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1784403352.399814:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afab43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb67 expref: 45 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.399836:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb67 expref: 44 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.399844:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:3.0:1784403352.399858:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784403352.399861:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4800, rc 0) 00000100:00100000:3.0:1784403352.399925:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+44:10399:x1871082240903680:12345-192.168.204.28@tcp:101:bash.0 Request processed in 18863us (19303us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1784403352.399932:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:0.0:1784403352.404667:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403352.404764:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240904064 00000100:00100000:3.0:1784403352.404774:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240904064 00000100:00100000:3.0:1784403352.404911:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:3.0:1784403352.404923:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+44:10399:x1871082240904064:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1784403352.405235:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.405253:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.405277:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784403352.405328:0:6294:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1784403352.405353:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f11669bc reply state 000000007ff6db08 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403352.405362:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784403352.405484:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:10399:x1871082240904064:12345-192.168.204.28@tcp:36:bash.0 Request processed in 562us (825us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1784403352.405492:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 58 00000020:00080000:3.0:1784403352.405496:0:6294:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784403352.408762:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.408781:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.408789:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.408795:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403352.408800:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.408808:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.408825:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:3.0:1784403352.408827:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403352.408847:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.408855:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403352.413046:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403352.413399:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240904192 00000100:00100000:3.0:1784403352.413410:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240904192 00000100:00100000:3.0:1784403352.413465:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:3.0:1784403352.413475:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+46:10399:x1871082240904192:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403352.413500:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403352.413521:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb6e expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.413607:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.413622:0:6293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb67 expref: 47 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.413631:0:6293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.413668:0:6293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb67 expref: 47 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.413682:0:6293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb67 expref: 47 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403352.413697:0:6293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b626300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260857600:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403352.413799:0:6293:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a51bd3300 going to sleep for 11 seconds 00010000:00010000:0.0:1784403352.415468:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403352.417727:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403352.417841:0:6293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b626300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260857600:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403352.417910:0:6293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403352.418117:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240904320 00000100:00100000:0.0:1784403352.418124:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240904320 00010000:00010000:0.0:1784403352.418174:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb67 expref: 48 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403352.418212:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:0.0:1784403352.418222:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+48:2360:x1871082240904320:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403352.418238:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403352.418246:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb67 expref: 48 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.418258:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb67 expref: 48 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.418280:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afab4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb67 expref: 48 pid: 10011 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.418295:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:0.0:1784403352.418300:0:6278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.418310:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.418318:0:6278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.418375:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403352.418440:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:2360:x1871082240904320:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 217us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403352.418447:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00010000:00010000:3.0:1784403352.418502:0:6293:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.418508:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403352.418553:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784403352.418557:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403352.418577:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.418607:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb6e expref: 47 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.418622:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb6e expref: 46 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.418630:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:3.0:1784403352.418633:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403352.418635:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7e00, rc 0) 00000100:00100000:3.0:1784403352.418661:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+46:10399:x1871082240904192:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5188us (5626us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403352.418668:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:2.0:1784403352.427948:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403352.428188:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240904576 00000100:00100000:1.0:1784403352.428200:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240904576 00000100:00100000:1.0:1784403352.428260:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:1.0:1784403352.428270:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497acc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+46:10399:x1871082240904576:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1784403352.428560:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497acc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:10399:x1871082240904576:12345-192.168.204.28@tcp:35:bash.0 Request processed in 290us (632us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1784403352.428568:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:1.0:1784403352.528008:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403352.528105:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240904832 00000100:00100000:0.0:1784403352.528115:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240904832 00000100:00100000:0.0:1784403352.528183:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:0.0:1784403352.528193:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:10409:x1871082240904832:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403352.528218:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403352.528239:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afab6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb75 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403352.528388:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1784403352.528506:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afab6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb75 expref: 49 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.528520:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:0.0:1784403352.528523:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784403352.528528:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afab6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb75 expref: 49 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403352.528541:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4c00, rc 0) 00000100:00100000:0.0:1784403352.528713:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+48:10409:x1871082240904832:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 520us (714us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1784403352.528721:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:0.0:1784403352.536610:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403352.536769:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240904960 00000100:00100000:3.0:1784403352.536785:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240904960 00000100:00100000:3.0:1784403352.536851:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:3.0:1784403352.536862:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+48:10409:x1871082240904960:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:3.0:1784403352.536992:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537011:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537025:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537040:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537047:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537055:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537183:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537193:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537200:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784403352.537241:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537266:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537272:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537279:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537285:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403352.537290:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537298:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537311:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:3.0:1784403352.537314:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403352.537318:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537324:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afab7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537336:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537342:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537348:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537360:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403352.537373:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537380:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537390:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a43245f00) 00010000:00010000:3.0:1784403352.537393:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403352.537396:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537402:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afab82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537418:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537425:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537431:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537437:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403352.537440:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537447:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537467:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:3.0:1784403352.537469:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403352.537472:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.537478:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afab89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403352.537685:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+48:10409:x1871082240904960:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 823us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403352.537695:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:2.0:1784403352.541315:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403352.541418:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240905216 00000100:00100000:1.0:1784403352.541428:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240905216 00000100:00100000:1.0:1784403352.541490:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:1.0:1784403352.541500:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+48:10409:x1871082240905216:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403352.541763:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+49:10409:x1871082240905216:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 264us (457us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1784403352.541771:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1784403352.577163:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403352.577275:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240905472 00000100:00100000:1.0:1784403352.577287:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240905472 00000100:00100000:1.0:1784403352.577350:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:1.0:1784403352.577371:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+49:10412:x1871082240905472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403352.577398:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403352.577421:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb7c expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577526:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afab97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577541:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afab97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577552:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afab97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577567:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afab9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577574:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afab9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577594:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afab9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577747:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaba5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577756:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577763:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403352.577772:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784403352.577908:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afab97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577915:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afab97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577929:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afab97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577935:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403352.577940:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afab97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577947:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afab97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577960:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:1.0:1784403352.577963:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403352.577967:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afab97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577974:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe600/0x6828175665afab97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577989:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afab9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.577996:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afab9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.578001:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afab9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.578006:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403352.578009:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afab9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.578026:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afab9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.578034:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a51bd0f00) 00010000:00010000:1.0:1784403352.578036:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403352.578038:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afab9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.578043:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff600/0x6828175665afab9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.578090:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ffc00/0x6828175665afab90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb7c expref: 52 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.578103:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb7c expref: 51 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.578110:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:1.0:1784403352.578112:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403352.578114:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0c00, rc 0) 00000100:00100000:1.0:1784403352.578184:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:10412:x1871082240905472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 823us (1040us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1784403352.578191:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:0.0:1784403352.583693:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403352.583776:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240905600 00000100:00100000:3.0:1784403352.583786:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240905600 00000100:00100000:3.0:1784403352.583839:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:3.0:1784403352.583848:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:10412:x1871082240905600:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:3.0:1784403352.583954:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.583973:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.583984:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.584015:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.584022:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.584040:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.584046:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403352.584050:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.584057:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.584069:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:3.0:1784403352.584073:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403352.584077:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.584083:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403352.584166:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:10412:x1871082240905600:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 317us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403352.584174:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:2.0:1784403352.587712:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403352.587809:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240905856 00000100:00100000:1.0:1784403352.587819:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240905856 00000100:00100000:1.0:1784403352.587918:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:1.0:1784403352.587928:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:10412:x1871082240905856:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403352.588342:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:10412:x1871082240905856:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 413us (638us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1784403352.588351:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:0.0:1784403352.603972:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403352.604063:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240905984 00000100:00100000:1.0:1784403352.604073:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240905984 00000100:00100000:1.0:1784403352.604272:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:1.0:1784403352.604283:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73696d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:2358:x1871082240905984:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403352.604301:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403352.604328:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaba5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb7c expref: 52 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.604349:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:1.0:1784403352.604354:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403352.604417:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73696d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:2358:x1871082240905984:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 136us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403352.604425:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:0.0:1784403352.726851:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403352.726974:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240906240 00000100:00100000:1.0:1784403352.726986:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240906240 00000100:00100000:1.0:1784403352.727051:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:1.0:1784403352.727062:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:10430:x1871082240906240:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:1.0:1784403352.727089:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403352.727112:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afabba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb83 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.727214:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afabc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.727248:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afabc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.727260:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afabc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403352.727274:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784403352.727416:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afabba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb83 expref: 54 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.727435:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afabc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb83 expref: 53 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.727445:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:1.0:1784403352.727448:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784403352.727452:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0a00, rc 0) 00000100:00100000:1.0:1784403352.727533:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+53:10430:x1871082240906240:12345-192.168.204.28@tcp:101:cat.0 Request processed in 472us (691us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1784403352.727541:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:2.0:1784403352.748672:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403352.748842:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240906368 00000100:00100000:3.0:1784403352.748853:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240906368 00000100:00100000:3.0:1784403352.748939:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:3.0:1784403352.748950:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+53:10431:x1871082240906368:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403352.748973:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403352.748994:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb8a expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.749084:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afabd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.749100:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afabd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.749112:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afabd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403352.749297:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1784403352.749303:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403352.749328:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afabd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.749356:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb8a expref: 55 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.749387:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afabd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb8a expref: 54 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.749395:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:3.0:1784403352.749398:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784403352.749402:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403352.749525:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:10431:x1871082240906368:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 576us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403352.749533:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:0.0:1784403352.754424:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403352.754555:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240906752 00000100:00100000:2.0:1784403352.754565:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240906752 00000100:00100000:2.0:1784403352.754742:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1784403352.754753:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:10431:x1871082240906752:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1784403352.755297:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10431:x1871082240906752:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 544us (882us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1784403352.755306:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:0.0:1784403352.757857:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403352.758455:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240906880 00000100:00100000:2.0:1784403352.758466:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240906880 00000100:00100000:2.0:1784403352.758534:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:2.0:1784403352.758545:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10431:x1871082240906880:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:2.0:1784403352.758561:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784403352.758597:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afab66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb6e expref: 55 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403352.758622:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afabc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb83 expref: 54 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403352.758635:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afaa71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb2f expref: 53 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403352.758666:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a4884dc00) 00010000:00010000:2.0:1784403352.758677:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403352.758746:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:10431:x1871082240906880:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 202us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403352.758754:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:3.0:1784403352.761241:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403352.761339:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240907008 00000100:00100000:1.0:1784403352.761348:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240907008 00000100:00100000:1.0:1784403352.761422:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:1.0:1784403352.761433:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:10431:x1871082240907008:12345-192.168.204.28@tcp:58:lfs.0 00010000:00010000:1.0:1784403352.761573:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afabdd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.761591:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afabdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.761617:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afabdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784403352.761962:0:6294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784403352.762168:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1784403352.762225:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1784403352.762326:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:10431:x1871082240907008:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 891us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403352.762335:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:1.0:1784403352.786529:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403352.786694:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240907136 00000100:00100000:3.0:1784403352.786717:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240907136 00000100:00100000:3.0:1784403352.786783:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:3.0:1784403352.786793:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:10433:x1871082240907136:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403352.786813:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403352.786836:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb91 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.786928:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afabeb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.786943:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afabeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.786955:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afabeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.786970:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afabf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.786976:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afabf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.786981:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afabf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787094:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787103:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787109:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403352.787160:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784403352.787163:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403352.787179:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787190:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787198:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afabeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787203:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afabeb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787209:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afabeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787214:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403352.787218:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afabeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787225:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afabeb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787235:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:3.0:1784403352.787238:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403352.787242:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afabeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787248:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afabeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787269:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afabf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.787276:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afabf2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.788842:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afabf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.788851:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403352.788855:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afabf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.788878:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afabf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.788895:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a43245f00) 00010000:00010000:3.0:1784403352.788899:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403352.788904:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afabf2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.788911:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afabf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.788965:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afabe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb91 expref: 54 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.788981:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb91 expref: 53 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403352.789006:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0f00) 00010000:00010000:3.0:1784403352.789009:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784403352.789011:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7c00, rc 0) 00000100:00100000:3.0:1784403352.789133:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+53:10433:x1871082240907136:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2340us (2612us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403352.789152:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:2.0:1784403352.800808:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784403352.800832:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260857728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403352.800945:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403352.801020:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260857728 00000100:00100000:2.0:1784403352.801028:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260857728 00000100:00100000:2.0:1784403352.801080:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784403352.801090:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260857728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403352.801125:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403352.801173:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260857728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403352.801180:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1784403352.801203:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403352.801237:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260857728:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1784403352.898448:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967345 is committed 00000001:00080000:1.0:1784403352.898483:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:1.0:1784403352.898508:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1784403352.898528:0:6314:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c8a736ac6c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1784403352.898534:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a4306e800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a736ac3c0 00000020:00080000:1.0:1784403352.898537:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a4306e100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a77e94000 00000001:00080000:1.0:1784403352.898560:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:1.0:1784403352.899098:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1784403352.899224:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1784403352.899235:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784403352.899255:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260857856:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784403352.899322:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403352.899406:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260857856 00000100:00100000:1.0:1784403352.899414:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260857856 00000100:00100000:1.0:1784403352.899474:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784403352.899484:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3568:x1871082260857856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784403352.899509:0:8571:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1784403352.899555:0:8571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a5bd596, atime: 0x6a5bd597, ctime: 0x6a5bd596, blocks: 0x1 00010000:00010000:1.0:1784403352.899563:0:8571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0726d9/0x6828175665afac00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.899652:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1784403352.899657:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403352.899664:0:8571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f0726d9/0x6828175665afac00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.899682:0:8571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f0726d9/0x6828175665afac00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.899693:0:8571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0726d9/0x6828175665afac00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.899702:0:8571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f0726d9/0x6828175665afac00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.899719:0:8571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784403352.900208:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3568:x1871082260857856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 724us (884us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784403352.900216:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1784403352.900242:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784403352.900256:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403352.900262:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f0726d9/0x6828175665afac00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.900272:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0e00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403352.900283:0:6279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0726d9/0x6828175665afac00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.900292:0:6279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0726d9/0x6828175665afac00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.900310:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f0726d9/0x6828175665afac00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.900317:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0726d9/0x6828175665afac00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403352.900336:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403352.900338:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403352.900339:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784403352.900387:0:3568:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a81b5b100/2, rc 0, transno 4294967301 00000100:00100000:1.0:1784403352.900395:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260857856:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784403353.440109:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784403353.611824:0:12367:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784403353.611837:0:12367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784403353.611974:0:12367:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784403353.611981:0:12367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1784403353.698031:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784403353.698041:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784403353.698106:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784403353.698117:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784403353.698260:0:12049:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72f07b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260857984:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784403353.698389:0:12049:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a44d29000 going to sleep for 11 seconds 00000100:00100000:2.0:1784403353.703145:0:12049:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72f07b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260857984:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784403353.705826:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403353.705990:0:6304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240907264 00000100:00100000:1.0:1784403353.706005:0:6304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240907264 00000100:00100000:1.0:1784403353.706077:0:6304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:1.0:1784403353.706089:0:6304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:10445:x1871082240907264:12345-192.168.204.28@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784403353.706198:0:6304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:10445:x1871082240907264:12345-192.168.204.28@tcp:900:lhsmtool_posix.0 Request processed in 111us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403353.706208:0:6304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:1.0:1784403353.724412:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403353.725721:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240907392 00000100:00100000:0.0:1784403353.725736:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240907392 00000100:00100000:0.0:1784403353.725816:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:0.0:1784403353.725828:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:10445:x1871082240907392:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784403353.726059:0:6294:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784403353.726194:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:10445:x1871082240907392:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 367us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403353.726203:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:3.0:1784403353.730185:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403353.730416:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240907520 00000100:00100000:0.0:1784403353.730427:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240907520 00000100:00100000:0.0:1784403353.730496:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:0.0:1784403353.730509:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:10445:x1871082240907520:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784403353.730610:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afac07 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730628:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afac07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730641:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afac07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730728:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afac0e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730749:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afac0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730756:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afac0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730786:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730795:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730801:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403353.730842:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1784403353.730847:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403353.730861:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730902:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afac07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730909:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afac07 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730915:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afac07 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730922:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403353.730926:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afac07 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730941:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afac07 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730953:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:0.0:1784403353.730956:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403353.730961:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afac07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730967:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afac07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730980:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afac0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730986:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afac0e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730992:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afac0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.730996:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403353.730999:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afac0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.731005:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afac0e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.731012:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8c8a4884d400) 00010000:00010000:0.0:1784403353.731014:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403353.731017:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afac0e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.731034:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afac0e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.731050:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.731056:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.731061:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.731066:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403353.731069:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.731075:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.731083:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0f00) 00010000:00010000:0.0:1784403353.731086:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403353.731089:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.731095:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403353.732227:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:10445:x1871082240907520:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 Request processed in 1714us (2561us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403353.732241:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:2.0:1784403353.736083:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403353.736256:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240907776 00000100:00100000:3.0:1784403353.736276:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240907776 00000100:00100000:3.0:1784403353.736354:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:3.0:1784403353.736365:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:10445:x1871082240907776:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403353.736387:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403353.736412:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afac1c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb98 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736513:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736528:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736540:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403353.736552:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784403353.736779:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736796:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736804:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736811:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403353.736815:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736823:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736836:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0f00) 00010000:00010000:3.0:1784403353.736839:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784403353.736843:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736849:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736913:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afac1c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb98 expref: 13 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736923:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:3.0:1784403353.736925:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403353.736929:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afac1c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb98 expref: 13 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.736938:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6800, rc 0) 00000100:00100000:3.0:1784403353.737007:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:10445:x1871082240907776:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 644us (938us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1784403353.737015:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:3.0:1784403353.746649:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403353.746756:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240907904 00000100:00100000:0.0:1784403353.746767:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240907904 00000100:00100000:0.0:1784403353.746826:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:0.0:1784403353.746836:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:10445:x1871082240907904:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784403353.746917:0:6293:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784403353.747039:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:10445:x1871082240907904:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 203us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403353.747047:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:2.0:1784403353.755540:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403353.755644:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240908160 00000100:00100000:3.0:1784403353.755656:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240908160 00000100:00100000:3.0:1784403353.755725:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:3.0:1784403353.755737:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:10445:x1871082240908160:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403353.755759:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403353.755763:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784403353.755795:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afabd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb8a expref: 12 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.755815:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:3.0:1784403353.755820:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784403353.755834:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afac31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eb9f expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784403353.758850:0:6294:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1784403353.759174:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afac38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.759191:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afac38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.759203:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afac38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.759271:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afac31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb9f expref: 14 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.759298:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afac38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb9f expref: 13 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.759307:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:3.0:1784403353.759311:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403353.759314:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6800, rc 0) 00000100:00100000:3.0:1784403353.759415:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:10445:x1871082240908160:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 3678us (3883us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1784403353.759426:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:0.0:1784403353.766038:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403353.766627:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240908416 00000100:00100000:3.0:1784403353.766640:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240908416 00000100:00100000:3.0:1784403353.766744:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00100000:3.0:1784403353.766756:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:10445:x1871082240908416:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784403353.766820:0:6293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403353.766852:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afac38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb9f expref: 13 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.766898:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:3.0:1784403353.766910:0:6293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784403353.766940:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.766955:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.766965:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.766988:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afac4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8c12c929 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.766995:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afac4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c12c929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767001:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afac4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c12c929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767321:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767330:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767337:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767354:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403353.767358:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767367:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767377:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:3.0:1784403353.767380:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403353.767384:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767391:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afac46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767408:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afac4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c12c929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767414:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afac4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c12c929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767420:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afac4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c12c929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767426:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403353.767430:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afac4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c12c929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767435:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afac4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c12c929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767444:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8c12c929 (ffff8c8a43245300) 00010000:00010000:3.0:1784403353.767447:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403353.767450:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afac4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8c12c929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.767456:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afac4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8c12c929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403353.767572:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:10445:x1871082240908416:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 804us (1534us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784403353.767580:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00100000:1.0:1784403353.773071:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403353.773247:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240908544 00000100:00100000:3.0:1784403353.773258:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240908544 00000100:00100000:3.0:1784403353.773326:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:3.0:1784403353.773352:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:10445:x1871082240908544:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403353.773376:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403353.773402:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afac54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eba6 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.773554:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.773570:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.773584:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.773684:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afac54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eba6 expref: 14 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.773704:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eba6 expref: 13 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.773714:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245c00) 00010000:00010000:3.0:1784403353.773722:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784403353.773726:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403353.773826:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:10445:x1871082240908544:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 484us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403353.773834:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:3.0:1784403353.779247:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403353.779415:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240908800 00000100:00100000:0.0:1784403353.779427:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240908800 00000100:00100000:0.0:1784403353.779531:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:0.0:1784403353.779544:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:10445:x1871082240908800:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784403353.779637:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.779656:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403353.779668:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784403353.782444:0:10011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1784403353.782477:0:10011:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359350609615ns, next at 360350604313ns, rc = 0 00000004:00010000:0.0:1784403353.782629:0:10011:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d1c014f reply state 00000000b0e85cd9 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403353.782642:0:10011:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784403353.783050:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:10445:x1871082240908800:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 3504us (3808us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1784403353.783069:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:1.0:1784403353.794205:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1784403353.794385:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.794399:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.794407:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.794415:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403353.794420:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.794428:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.794447:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245c00) 00010000:00010000:2.0:1784403353.794451:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784403353.794456:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.794462:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afac62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403353.794509:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240908928 00000100:00100000:2.0:1784403353.794519:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240908928 00000100:00100000:2.0:1784403353.794713:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:2.0:1784403353.794725:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:10445:x1871082240908928:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784403353.794751:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403353.794771:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afac69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebad expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.794831:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afac69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebad expref: 15 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.794844:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afac69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebad expref: 15 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.794894:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245c00) 00010000:00010000:2.0:1784403353.794897:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784403353.794900:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2600, rc 0) 00000100:00100000:2.0:1784403353.794964:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:10445:x1871082240908928:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 242us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403353.794971:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:3.0:1784403353.801604:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403353.801685:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240909056 00000100:00100000:2.0:1784403353.801697:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240909056 00000100:00100000:2.0:1784403353.801745:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:2.0:1784403353.801754:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1871082240909056:12345-192.168.204.28@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1784403353.801788:0:7102:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:2.0:1784403353.801833:0:7102:0:(genops.c:1385:class_connect()) connect: client becd6ccb-dd35-46e6-9ecf-44ee31a105f1, cookie 0x6828175665afac70 00002000:00100000:2.0:1784403353.801845:0:7102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli becd6ccb-dd35-46e6-9ecf-44ee31a105f1/ffff8c8a7303c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784403353.801857:0:7102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784403353.802131:0:7102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784403353.802161:0:7102:0:(import.c:65:import_set_state_nolock()) ffff8c8a7303a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784403353.802232:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2357:x1871082240909056:12345-192.168.204.28@tcp:8:lhsmtool_posix.0 Request processed in 476us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403353.802240:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:3.0:1784403353.808011:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403353.808058:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240909184 00000100:00100000:3.0:1784403353.808067:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240909184 00000100:00100000:3.0:1784403353.810020:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:3.0:1784403353.810041:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:0:x1871082240909184:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1784403353.810905:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403353.903747:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:0:x1871082240909184:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 93703us (95732us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784403353.903762:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 26 00000001:00100000:1.0:1784403353.904506:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000001:00080000:1.0:1784403353.904522:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1784403353.907679:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403353.907862:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240909440 00000100:00100000:1.0:1784403353.907911:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240909440 00000100:00100000:1.0:1784403353.907972:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:1.0:1784403353.907982:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:10445:x1871082240909440:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784403353.910207:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:10445:x1871082240909440:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 263us (576us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1784403353.910222:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1784403353.915835:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403353.916035:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240909696 00000100:00100000:3.0:1784403353.916045:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240909696 00000100:00100000:2.0:1784403353.916217:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:2.0:1784403353.916230:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:10445:x1871082240909696:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784403353.916362:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:10445:x1871082240909696:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 133us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403353.916369:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:3.0:1784403353.919412:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403353.919632:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240909824 00000100:00100000:2.0:1784403353.919643:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240909824 00000100:00100000:2.0:1784403353.919706:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:2.0:1784403353.919717:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:10445:x1871082240909824:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784403353.919739:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403353.919761:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afac77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebb4 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.919838:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.919853:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.919920:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403353.919964:0:6292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403353.919990:0:6292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.920017:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afac77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebb4 expref: 18 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.920038:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebb4 expref: 17 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.920046:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245c00) 00010000:00010000:2.0:1784403353.920049:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784403353.920053:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3200, rc 0) 00000100:00100000:2.0:1784403353.920595:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:10445:x1871082240909824:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 876us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403353.920604:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:0.0:1784403353.925546:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403353.925595:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240909952 00000100:00100000:2.0:1784403353.925606:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240909952 00000100:00100000:2.0:1784403353.925673:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:2.0:1784403353.925684:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240909952:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784403353.925704:0:7102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403353.925730:0:7102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f944349/0x6828175665afac85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebbb expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784403353.925775:0:7102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bd59a, blocks: 0x1 00010000:00010000:2.0:1784403353.925793:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1784403353.925798:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403353.925808:0:7102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f944349/0x6828175665afac85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebbb expref: 6 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.925834:0:7102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f944349/0x6828175665afac85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebbb expref: 6 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.925847:0:7102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2400, rc 0) 00000100:00100000:2.0:1784403353.925930:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2359:x1871082240909952:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 248us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403353.925937:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:1.0:1784403353.929972:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403353.934793:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240910208 00000100:00100000:0.0:1784403353.934808:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240910208 00000100:00100000:2.0:1784403353.934966:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:2.0:1784403353.934981:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:10445:x1871082240910208:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784403353.935103:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:10445:x1871082240910208:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 127us (5140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403353.935111:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:1.0:1784403353.939557:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403353.940320:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240910336 00000100:00100000:3.0:1784403353.940332:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240910336 00000100:00100000:3.0:1784403353.940415:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:3.0:1784403353.940426:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:10445:x1871082240910336:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403353.940544:0:7099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403353.940730:0:7099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebc2 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.940767:0:7099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f944349/0x6828175665afac85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebbb expref: 7 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.940777:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403353.940781:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403353.940787:0:7099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 7 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.940846:0:7099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f944349/0x6828175665afac85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebbb expref: 7 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403353.940860:0:7099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f944349/0x6828175665afac85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebbb expref: 7 pid: 7102 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403353.940891:0:7099:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7099:1871082260858112:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403353.940990:0:7099:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403353.950704:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403353.950835:0:7099:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7099:1871082260858112:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403353.950905:0:7099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 7 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403353.950929:0:7099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:1.0:1784403353.950993:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:10445:x1871082240910336:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 10569us (11447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403353.951003:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:2.0:1784403353.951257:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240910464 00000100:00100000:2.0:1784403353.951266:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240910464 00010000:00010000:2.0:1784403353.951308:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f944349/0x6828175665afac85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebbb expref: 7 pid: 7102 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403353.951356:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:2.0:1784403353.951380:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240910464:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403353.951396:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403353.951419:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f944349/0x6828175665afac85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebbb expref: 7 pid: 7102 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.951432:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f944349/0x6828175665afac85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebbb expref: 7 pid: 7102 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.951455:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f944349/0x6828175665afac85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebbb expref: 7 pid: 7102 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.951470:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403353.951475:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403353.951484:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 6 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.951494:0:6277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 6 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403353.951527:0:6277:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 6 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403353.951539:0:6277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72f04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6277:1871082260858240:192.168.204.28@tcp:105: 00000100:00100000:2.0:1784403353.951596:0:6277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403353.959938:0:6277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72f04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6277:1871082260858240:192.168.204.28@tcp:105: 00010000:00010000:1.0:1784403353.959973:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403353.960040:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240910464:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 8660us (9347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403353.960052:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:3.0:1784403353.963617:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403353.963731:0:7107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240910592 00000100:00100000:1.0:1784403353.963741:0:7107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240910592 00002000:00100000:1.0:1784403353.963788:0:7107:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8c8a7b624380 x1871082240910592/t0(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:124/0 lens 504/0 e 0 to 0 dl 1784403364 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784403353.963798:0:7107:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a7b624380 with x1871082240910592 ext(0->8) 00002000:00010000:1.0:1784403353.963803:0:7107:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a7b624380 00000100:00100000:1.0:1784403353.963840:0:7107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:1.0:1784403353.963849:0:7107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240910592:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784403353.965023:0:7107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2361:x1871082240910592:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 Request processed in 1169us (1412us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784403353.965038:0:7107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00002000:00100000:0.0:1784403353.965048:0:7107:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8c8a7b624380 x1871082240910592/t4294967302(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:124/0 lens 504/448 e 0 to 0 dl 1784403364 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784403353.965060:0:7107:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a7b624380 with x1871082240910592 ext(0->8) 00002000:00010000:0.0:1784403353.965065:0:7107:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a7b624380 00000100:00100000:3.0:1784403353.971395:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403353.971629:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240910720 00000100:00100000:1.0:1784403353.971640:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240910720 00000100:00100000:1.0:1784403353.971706:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:1.0:1784403353.971718:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:10445:x1871082240910720:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1784403354.033219:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:10445:x1871082240910720:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 Request processed in 61492us (61824us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403354.033234:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 80 00000001:00080000:2.0:1784403354.034385:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1784403354.034414:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1784403354.034436:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1784403354.034442:0:6314:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1784403354.037829:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1784403354.037853:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1784403354.038613:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7749aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260858368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784403354.038693:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403354.038770:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260858368 00000100:00100000:0.0:1784403354.038779:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260858368 00000100:00080000:1.0:1784403354.038885:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403354.038958:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784403354.038969:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260858368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1784403354.039167:0:7102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784403354.039171:0:7102:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784403354 00002000:00010000:0.0:1784403354.039173:0:7102:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784403354.039176:0:7102:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784403354 -> 1784403354 00002000:00010000:0.0:1784403354.039178:0:7102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784403354.039221:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3568:x1871082260858368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 255us (528us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1784403354.039229:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1784403354.041184:0:3568:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a7749aa00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1784403354.041201:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7749aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260858368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784403354.043883:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403354.045315:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240910848 00000100:00100000:3.0:1784403354.045331:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240910848 00000100:00100000:3.0:1784403354.045487:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:3.0:1784403354.045498:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2359:x1871082240910848:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1784403354.128040:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1784403354.128057:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1784403354.128773:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2359:x1871082240910848:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 Request processed in 83269us (84910us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403354.128786:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:1.0:1784403354.135282:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403354.135418:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240911104 00000100:00100000:2.0:1784403354.135429:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240911104 00000100:00100000:2.0:1784403354.136019:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:2.0:1784403354.136040:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:10445:x1871082240911104:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784403354.136096:0:6293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403354.136127:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebb4 expref: 13 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.136149:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245c00) 00010000:00010000:2.0:1784403354.136155:0:6293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403354.136187:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.136204:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.136215:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403354.136500:0:6293:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075050303 reply state 00000000d03c20ba transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403354.136526:0:6293:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784403354.136641:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:10445:x1871082240911104:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 610us (1370us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1784403354.136649:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00080000:1.0:1784403354.137057:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403354.141072:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403354.141115:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240911232 00000100:00100000:0.0:1784403354.141125:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240911232 00000100:00100000:0.0:1784403354.141193:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:0.0:1784403354.141205:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240911232:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784403354.141627:0:7102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784403354.141631:0:7102:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1784403354 -> 1784403352 00002000:00010000:0.0:1784403354.141634:0:7102:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784403351 00002000:00010000:0.0:1784403354.141637:0:7102:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784403354 -> 1784403352 00002000:00010000:0.0:1784403354.141639:0:7102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1784403354.141707:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240911232:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 504us (644us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1784403354.141715:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00010000:00010000:1.0:1784403354.142554:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.142568:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.142576:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.142601:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403354.142606:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.142613:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.142631:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245c00) 00010000:00010000:1.0:1784403354.142634:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403354.142638:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.142645:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afac93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403354.145850:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403354.146928:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240911488 00000100:00100000:2.0:1784403354.146942:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240911488 00000100:00100000:2.0:1784403354.147012:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:2.0:1784403354.147023:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:10445:x1871082240911488:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784403354.147093:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.147111:0:6292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eba6 expref: 13 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.147133:0:6292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.147171:0:6292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eba6 expref: 13 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.147186:0:6292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eba6 expref: 13 pid: 6294 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403354.147202:0:6292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72f05880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6292:1871082260858496:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403354.147298:0:6292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a584a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1784403354.154396:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403354.154694:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240911616 00000100:00100000:0.0:1784403354.154703:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240911616 00010000:00010000:0.0:1784403354.154746:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eba6 expref: 14 pid: 6294 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403354.154796:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:0.0:1784403354.154806:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2360:x1871082240911616:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403354.154822:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403354.154829:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eba6 expref: 14 pid: 6294 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.154854:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eba6 expref: 14 pid: 6294 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.154928:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245c00) 00010000:00010000:0.0:1784403354.154933:0:6278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.154943:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.154950:0:6278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.154970:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403354.155019:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2360:x1871082240911616:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 214us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403354.155027:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00010000:00010000:2.0:1784403354.155508:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afac5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eba6 expref: 13 pid: 6294 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403354.155528:0:6292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72f05880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6292:1871082260858496:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403354.155550:0:6292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.155568:0:6292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.155574:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.155607:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.155614:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.155621:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.155627:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403354.155632:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.155640:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.155651:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245c00) 00010000:00010000:2.0:1784403354.155654:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784403354.155668:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403354.155675:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afac9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403354.155937:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:10445:x1871082240911488:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 Request processed in 8914us (10097us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784403354.155947:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:3.0:1784403354.159633:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403354.159700:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240911744 00000100:00100000:1.0:1784403354.159710:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240911744 00000100:00100000:1.0:1784403354.159772:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:1.0:1784403354.159783:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240911744:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784403354.159836:0:7099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.159859:0:7099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 7 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.159909:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403354.159913:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784403354.159918:0:7099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.159972:0:7099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 7 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.159988:0:7099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 7 pid: 7099 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403354.160003:0:7099:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7099:1871082260858624:192.168.204.28@tcp:104: 00000100:00100000:1.0:1784403354.160089:0:7099:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45350540 going to sleep for 11 seconds 00000100:00100000:1.0:1784403354.163726:0:7099:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7099:1871082260858624:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403354.163763:0:7099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403354.165186:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403354.165290:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240911872 00000100:00100000:1.0:1784403354.165299:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240911872 00010000:00010000:1.0:1784403354.165359:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 8 pid: 7099 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403354.165411:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:1.0:1784403354.165422:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2361:x1871082240911872:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403354.165438:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403354.165463:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 8 pid: 7099 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.165488:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 8 pid: 7099 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.165533:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afac8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc2 expref: 8 pid: 7099 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.165552:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784403354.165568:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784403354.165574:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.165585:0:6277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.165621:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403354.165683:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240911872:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 262us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403354.165691:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00010000:00010000:3.0:1784403354.166062:0:7099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.166072:0:7099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.166110:0:7099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.166119:0:7099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.166127:0:7099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.166134:0:7099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403354.166138:0:7099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.166147:0:7099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.166160:0:7099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.166168:0:7099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afaca1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403354.166230:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240911744:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 Request processed in 6448us (6607us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403354.166239:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:3.0:1784403354.169757:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403354.170059:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240912128 00000100:00100000:0.0:1784403354.170069:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240912128 00000100:00100000:0.0:1784403354.170139:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:0.0:1784403354.170150:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:10445:x1871082240912128:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784403354.170230:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaca8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.170248:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.170259:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.170491:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.170521:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afac69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebad expref: 13 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.170530:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.170570:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afac69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebad expref: 13 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.170585:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afac69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebad expref: 13 pid: 6292 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403354.170601:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73694380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260858752:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403354.170707:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410afa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784403354.174656:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403354.174890:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73694380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260858752:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403354.174918:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403354.175399:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240912256 00000100:00100000:1.0:1784403354.175407:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240912256 00010000:00010000:1.0:1784403354.175736:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afac69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebad expref: 14 pid: 6292 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403354.175834:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:1.0:1784403354.175846:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2360:x1871082240912256:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403354.175863:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403354.175890:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afac69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebad expref: 14 pid: 6292 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.175922:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afac69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebad expref: 14 pid: 6292 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.175945:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afac69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebad expref: 14 pid: 6292 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.175962:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245c00) 00010000:00010000:1.0:1784403354.175968:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.175977:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.175984:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.176014:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403354.176077:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:2360:x1871082240912256:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 233us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403354.176085:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00010000:00010000:3.0:1784403354.176148:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.176156:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784403354.176365:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1784403354.176529:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1784403354.176591:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1784403354.176676:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260858880:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784403354.176736:0:10011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403354.176772:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403354.176801:0:6298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260858880 00000100:00100000:3.0:1784403354.176806:0:6298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260858880 00000100:00100000:3.0:1784403354.176838:0:6298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784403354.176846:0:6298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10011:x1871082260858880:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784403354.176970:0:6298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10011:x1871082260858880:12345-0@lo:1000:mdt00_003.0 Request processed in 124us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403354.176977:0:6298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784403354.177009:0:10011:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1784403354.177014:0:10011:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a7749aa00, transno 4294967303 00000100:00100000:3.0:1784403354.177028:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260858880:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1784403354.177450:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1784403354.177511:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260859008:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784403354.177544:0:10011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403354.177562:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49ca4780 going to sleep for 11 seconds 00000100:00100000:3.0:1784403354.177576:0:6298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260859008 00000100:00100000:3.0:1784403354.177580:0:6298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260859008 00000100:00100000:3.0:1784403354.177600:0:6298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784403354.177606:0:6298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10011:x1871082260859008:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784403354.177757:0:6298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10011:x1871082260859008:12345-0@lo:1000:mdt00_003.0 Request processed in 150us (211us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784403354.177763:0:6298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784403354.177795:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260859008:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784403354.177822:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177831:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177838:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177845:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403354.177850:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177857:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177895:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a43245c00) 00010000:00010000:3.0:1784403354.177898:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403354.177910:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177917:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afacaf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177953:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afabdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177959:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afabdd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177965:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afabdd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177970:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403354.177973:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afabdd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177979:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afabdd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177988:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0f00) 00010000:00010000:3.0:1784403354.177990:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403354.177993:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afabdd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.177998:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afabdd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.178019:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.178034:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb91 expref: 16 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.178049:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.178075:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb91 expref: 16 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403354.178090:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb91 expref: 16 pid: 6293 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403354.178101:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260859136:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403354.178149:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d56d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784403354.182857:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403354.182969:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240912384 00000100:00100000:1.0:1784403354.182977:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240912384 00010000:00010000:1.0:1784403354.183019:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb91 expref: 17 pid: 6293 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403354.183065:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:1.0:1784403354.183075:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:2360:x1871082240912384:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403354.183109:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403354.183129:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb91 expref: 17 pid: 6293 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.183142:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb91 expref: 17 pid: 6293 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.183166:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0f00) 00010000:00010000:1.0:1784403354.183171:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.183181:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.183189:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403354.183209:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403354.183261:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:2360:x1871082240912384:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 188us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403354.183269:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00010000:00010000:0.0:1784403354.188681:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afabf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eb91 expref: 16 pid: 6293 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403354.188709:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260859136:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403354.188738:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.188748:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.188753:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.188787:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.188793:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.188800:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.188806:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403354.188810:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.188817:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.188835:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0f00) 00010000:00010000:0.0:1784403354.188838:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403354.188842:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.188848:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afacb6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.188858:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.189002:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaca8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.189011:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.189021:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403354.189025:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.189031:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaca8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.189040:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0f00) 00010000:00010000:0.0:1784403354.189042:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784403354.189045:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaca8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.189051:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afaca8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403354.189458:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:10445:x1871082240912128:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 19308us (19712us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1784403354.189469:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 83 00000020:00080000:0.0:1784403354.189476:0:10011:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1784403354.191492:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403354.191820:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240912640 00000100:00100000:0.0:1784403354.191831:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240912640 00000100:00100000:0.0:1784403354.191903:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:0.0:1784403354.191913:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:10445:x1871082240912640:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784403354.192574:0:6296:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784403354.192682:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1784403354.192726:0:6296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.192743:0:6296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.192763:0:6296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.192772:0:6296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.192778:0:6296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.192784:0:6296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.192805:0:6296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784403354.192910:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:10445:x1871082240912640:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 997us (1424us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1784403354.192919:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000020:00080000:0.0:1784403354.192924:0:6296:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784403354.192950:0:8813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403354.192955:0:8813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.192962:0:8813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403354.192966:0:8813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.192974:0:8813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.192986:0:8813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c8a4884d400) 00010000:00010000:0.0:1784403354.192989:0:8813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784403354.192998:0:8813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.193005:0:8813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afacbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403354.193020:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403354.193022:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403354.193024:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784403354.195299:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784403354.195309:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784403354.195358:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784403354.195364:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784403354.463808:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403354.849574:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260859392:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.849644:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403354.849696:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260859904:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.849734:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403354.849764:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784403354.849770:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260859264:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.849798:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403354.849821:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260859776:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.849843:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403354.849890:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260859520:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.849916:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403354.849944:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784403354.849950:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260859648:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.849971:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403354.850001:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260859392 00000100:00100000:3.0:1784403354.850008:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260859392 00000100:00100000:3.0:1784403354.850051:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260859776 00000100:00100000:3.0:1784403354.850054:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260859776 00000100:00100000:3.0:1784403354.850079:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260859520 00000100:00100000:3.0:1784403354.850082:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260859520 00000100:00100000:3.0:1784403354.851155:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784403354.851170:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260859392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.851247:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260859392:12345-0@lo:400:kworker.0 Request processed in 82us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403354.851254:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784403354.851273:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784403354.851280:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260859776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.851307:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260859776:12345-0@lo:400:kworker.0 Request processed in 28us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403354.851312:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784403354.851334:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784403354.851342:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260859520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.851374:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260859520:12345-0@lo:400:kworker.0 Request processed in 33us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403354.851380:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784403354.851403:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260859904 00000100:00100000:3.0:1784403354.851410:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260859904 00000100:00100000:3.0:1784403354.851441:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260859648 00000100:00100000:3.0:1784403354.851444:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260859648 00000100:00100000:3.0:1784403354.851470:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784403354.851476:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a738dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3566:x1871082260859904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.851508:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a738dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3566:x1871082260859904:12345-0@lo:400:kworker.0 Request processed in 32us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403354.851514:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784403354.851665:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784403354.851672:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3567:x1871082260859648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.851702:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3567:x1871082260859648:12345-0@lo:400:kworker.0 Request processed in 31us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403354.851707:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784403354.851727:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260859264 00000100:00100000:3.0:1784403354.851730:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260859264 00000100:00100000:3.0:1784403354.851755:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1784403354.851761:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260859264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.851794:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260859264:12345-0@lo:400:kworker.0 Request processed in 33us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403354.851800:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:3.0:1784403354.851831:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784403354.851836:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403354.851885:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260859264:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.851902:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260859776:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.851912:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260859392:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.851922:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260859904:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.851985:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260859648:0@lo:400:kworker.0 00000100:00100000:3.0:1784403354.852018:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260859520:0@lo:400:kworker.0 00000040:00080000:2.0:1784403355.231333:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784403355.231344:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784403355.231384:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784403355.231391:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784403355.359190:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260860032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403355.359267:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403355.359332:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260860032 00000100:00100000:2.0:1784403355.359342:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260860032 00000100:00100000:2.0:1784403355.359403:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784403355.359415:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260860032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403355.359453:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403355.359512:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260860032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403355.359520:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784403355.359656:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260860032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784403355.489736:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784403355.559810:0:12418:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403355.559819:0:12418:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784403355.560048:0:12418:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784403355.560057:0:12418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784403355.698983:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403355.699108:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240912896 00000100:00100000:0.0:1784403355.699120:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240912896 00000100:00100000:0.0:1784403355.699182:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:0.0:1784403355.699194:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:10462:x1871082240912896:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403355.699221:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403355.699248:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afacc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebc9 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403355.699576:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaccb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403355.699594:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403355.699607:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403355.699619:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1784403355.699813:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afacc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc9 expref: 20 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403355.699834:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaccb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc9 expref: 19 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403355.699843:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403355.699846:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784403355.699849:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5200, rc 0) 00000100:00100000:0.0:1784403355.699949:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:10462:x1871082240912896:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 757us (977us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1784403355.699958:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:2.0:1784403355.707594:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403355.712560:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240913024 00000100:00100000:3.0:1784403355.712644:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240913024 00000100:00100000:3.0:1784403355.713107:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:3.0:1784403355.713117:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:10462:x1871082240913024:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:3.0:1784403355.713191:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afacd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.713208:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afacd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.713219:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afacd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.713233:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665aface0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.713240:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665aface0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.713246:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665aface0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.713618:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.713636:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.713645:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784403355.715881:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.715906:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afacd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.715914:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afacd9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.715922:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afacd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.715928:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403355.715932:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afacd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.715939:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afacd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.715953:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:3.0:1784403355.715957:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403355.715961:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afacd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.715969:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afacd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.715996:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665aface0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716003:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665aface0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716009:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665aface0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716014:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403355.716017:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665aface0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716022:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665aface0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716030:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a43245c00) 00010000:00010000:3.0:1784403355.716033:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403355.716035:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665aface0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716041:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665aface0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716056:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716063:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716069:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716080:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403355.716083:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716090:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716098:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a43245300) 00010000:00010000:3.0:1784403355.716100:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403355.716103:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.716108:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665aface7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403355.716196:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:10462:x1871082240913024:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 3075us (8619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403355.716206:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:0.0:1784403355.770221:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403355.770296:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240913280 00000100:00100000:1.0:1784403355.770314:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240913280 00000100:00100000:1.0:1784403355.770380:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:1.0:1784403355.770391:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:10465:x1871082240913280:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403355.770425:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403355.770460:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afacee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebd0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.770557:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afacf5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.770573:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afacf5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.770585:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afacf5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.770599:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afacfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.770606:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afacfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.770612:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afacfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.770983:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.770992:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771000:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403355.771008:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1784403355.771098:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afacf5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771116:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afacf5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771123:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afacf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771130:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403355.771134:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afacf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771142:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afacf5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771154:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:1.0:1784403355.771157:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403355.771162:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afacf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771168:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afacf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771181:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afacfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771186:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afacfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771191:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afacfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771197:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403355.771221:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afacfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771228:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afacfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771236:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a51bd0a00) 00010000:00010000:1.0:1784403355.771238:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403355.771241:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afacfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771246:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afacfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771287:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afacee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd0 expref: 22 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771301:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd0 expref: 21 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.771323:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:1.0:1784403355.771326:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403355.771328:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1c00, rc 0) 00000100:00100000:1.0:1784403355.771396:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:10465:x1871082240913280:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1007us (1186us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1784403355.771405:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:1.0:1784403355.781993:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403355.782109:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240913408 00000100:00100000:1.0:1784403355.782121:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240913408 00000100:00100000:1.0:1784403355.782176:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:1.0:1784403355.782197:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:10465:x1871082240913408:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:1.0:1784403355.782272:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.782290:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.782301:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.782343:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.782350:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.782357:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.782363:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403355.782366:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.782374:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.782385:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:1.0:1784403355.782388:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784403355.782392:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.782399:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403355.782475:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:10465:x1871082240913408:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 281us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403355.782482:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:0.0:1784403355.792920:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403355.792964:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240913664 00000100:00100000:0.0:1784403355.792976:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240913664 00000100:00100000:0.0:1784403355.793031:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:0.0:1784403355.793041:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497adc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:10465:x1871082240913664:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1784403355.793273:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497adc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+22:10465:x1871082240913664:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 232us (365us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1784403355.793282:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:0.0:1784403355.862129:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403355.862295:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240913920 00000100:00100000:1.0:1784403355.862312:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240913920 00000100:00100000:1.0:1784403355.862375:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:1.0:1784403355.862385:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+22:9985:x1871082240913920:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1784403355.862548:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403355.862570:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad18 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebd7 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.862664:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.862678:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd0 expref: 23 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.862686:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.862716:0:6294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd0 expref: 23 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.862729:0:6294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd0 expref: 23 pid: 6294 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403355.862742:0:6294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77498700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260860160:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403355.863610:0:6294:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45350600 going to sleep for 11 seconds 00000100:00100000:0.0:1784403355.866520:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403355.866594:0:6294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77498700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260860160:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403355.866627:0:6294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403355.866731:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240914048 00000100:00100000:1.0:1784403355.866739:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240914048 00010000:00010000:1.0:1784403355.866778:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd0 expref: 24 pid: 6294 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403355.866816:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:1.0:1784403355.866827:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:2360:x1871082240914048:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403355.866841:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403355.866848:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd0 expref: 24 pid: 6294 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.866860:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd0 expref: 24 pid: 6294 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.866910:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afad03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd0 expref: 24 pid: 6294 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.866926:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:1.0:1784403355.866931:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.866940:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.866948:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403355.866974:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403355.867026:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:2360:x1871082240914048:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 200us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403355.867040:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00010000:00010000:2.0:1784403355.867340:0:6294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.867382:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403355.867597:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1784403355.867862:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afad18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd7 expref: 24 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.867950:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd7 expref: 23 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.867959:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:2.0:1784403355.867962:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784403355.867964:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1800, rc 0) 00000100:00100000:2.0:1784403355.868035:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:9985:x1871082240913920:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5650us (5915us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1784403355.868055:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:1.0:1784403355.874071:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403355.874664:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240914304 00000100:00100000:3.0:1784403355.874730:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240914304 00000100:00100000:3.0:1784403355.874810:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 89 00000100:00100000:3.0:1784403355.874854:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:9985:x1871082240914304:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1784403355.876375:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.876563:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.876577:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784403355.876652:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1784403355.876690:0:10011:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050985e3e reply state 00000000f8bfa61a transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403355.876699:0:10011:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1784403355.876756:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1784403355.876898:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:9985:x1871082240914304:12345-192.168.204.28@tcp:36:bash.0 Request processed in 2076us (2837us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1784403355.876908:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 89 00000020:00080000:3.0:1784403355.876913:0:10011:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1784403355.879782:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.879802:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.879809:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.879815:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403355.879900:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.879910:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.879927:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:3.0:1784403355.879930:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403355.879934:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.879957:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afad2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403355.882457:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403355.885127:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240914432 00000100:00100000:0.0:1784403355.885156:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240914432 00000100:00100000:0.0:1784403355.885240:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:0.0:1784403355.885250:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:9985:x1871082240914432:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403355.885291:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403355.885323:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afad34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebde expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403355.885395:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afad34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebde expref: 27 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403355.885412:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afad34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebde expref: 27 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403355.885431:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:0.0:1784403355.885435:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784403355.885438:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5000, rc 0) 00000100:00100000:0.0:1784403355.885522:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:9985:x1871082240914432:12345-192.168.204.28@tcp:101:bash.0 Request processed in 272us (3076us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403355.885530:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:1.0:1784403355.891823:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403355.893691:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240914560 00000100:00100000:3.0:1784403355.893716:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240914560 00000100:00100000:3.0:1784403355.893804:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:3.0:1784403355.893816:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:9985:x1871082240914560:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403355.893846:0:7101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403355.893885:0:7101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afad3b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebe5 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784403355.893914:0:7101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a5bd598, atime: 0x6a5bd597, ctime: 0x6a5bd598, blocks: 0xb 00010000:00010000:3.0:1784403355.893937:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1784403355.893943:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403355.893952:0:7101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afad3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebe5 expref: 7 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.893971:0:7101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afad3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebe5 expref: 7 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.893983:0:7101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6600, rc 0) 00000100:00100000:3.0:1784403355.894042:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:9985:x1871082240914560:12345-192.168.204.28@tcp:101:bash.0 Request processed in 228us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403355.894050:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00080000:1.0:1784403355.894795:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403355.899820:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403355.900283:0:7105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240914688 00000100:00100000:3.0:1784403355.900295:0:7105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240914688 00002000:00010000:3.0:1784403355.900364:0:7105:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1784403355.900369:0:7105:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a77499c00 with x1871082240914688 ext(0->18446744073709551615) 00002000:00010000:3.0:1784403355.900383:0:7105:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a77499c00. 00000100:00100000:3.0:1784403355.900423:0:7105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:3.0:1784403355.900434:0:7105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240914688:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1784403355.901531:0:7105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784403355.901538:0:7105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1784403352 -> 1784403356 00002000:00010000:3.0:1784403355.901541:0:7105:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1784403351 -> 1784403351 00002000:00010000:3.0:1784403355.901543:0:7105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784403352 -> 1784403356 00002000:00010000:3.0:1784403355.901544:0:7105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1784403355.901612:0:7105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2361:x1871082240914688:12345-192.168.204.28@tcp:10:bash.0 Request processed in 1177us (1800us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784403355.901621:0:7105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00002000:00010000:3.0:1784403355.901625:0:7105:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1784403355.901628:0:7105:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a77499c00 with x1871082240914688 ext(0->18446744073709551615) 00002000:00010000:3.0:1784403355.901634:0:7105:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a77499c00. 00000001:00080000:2.0:1784403355.941334:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:2.0:1784403355.941351:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1784403355.941357:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1784403355.984352:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403355.984721:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240914816 00000100:00100000:3.0:1784403355.984733:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240914816 00000100:00100000:3.0:1784403355.984796:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00100000:3.0:1784403355.984808:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:10479:x1871082240914816:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:3.0:1784403355.984930:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afad42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.984950:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afad42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403355.984964:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afad42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.985711:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.985726:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.985735:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986068:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986091:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986105:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403355.986148:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986160:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afad42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986168:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afad42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986175:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afad42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986180:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403355.986184:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afad42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986192:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afad42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986204:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:2.0:1784403355.986207:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403355.986211:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afad42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986224:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afad42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986237:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986243:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986248:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986253:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403355.986255:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986261:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986267:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a429d0200) 00010000:00010000:2.0:1784403355.986270:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403355.986273:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986277:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986291:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986298:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986318:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986324:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403355.986326:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986333:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986340:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:2.0:1784403355.986342:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403355.986346:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403355.986351:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403355.986444:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:10479:x1871082240914816:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 1635us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403355.986453:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00100000:0.0:1784403356.028791:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403356.029101:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240915072 00000100:00100000:2.0:1784403356.029112:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240915072 00000100:00080000:1.0:1784403356.029180:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403356.029189:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:2.0:1784403356.029201:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:10482:x1871082240915072:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403356.029223:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403356.029245:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebec expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029363:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029380:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029392:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029407:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afad65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029414:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afad65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029421:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afad65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029753:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afad6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029763:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afad6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029770:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afad6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403356.029779:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784403356.029917:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029925:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029937:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029943:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403356.029947:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029954:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029967:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:2.0:1784403356.029970:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403356.029975:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029981:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afad5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029992:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afad65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.029998:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afad65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.030004:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afad65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.030008:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403356.030011:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afad65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.030026:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afad65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.030035:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a429d0200) 00010000:00010000:2.0:1784403356.030038:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403356.030042:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afad65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.030047:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afad65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.030093:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afad57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebec expref: 30 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.030108:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afad6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebec expref: 29 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.030115:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:2.0:1784403356.030117:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784403356.030119:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2400, rc 0) 00000100:00100000:2.0:1784403356.030188:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:10482:x1871082240915072:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 988us (1406us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1784403356.030197:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:1.0:1784403356.035094:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403356.035243:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240915200 00000100:00100000:2.0:1784403356.035256:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240915200 00000100:00100000:2.0:1784403356.035334:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:2.0:1784403356.035345:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:10482:x1871082240915200:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:2.0:1784403356.035437:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.035455:0:6293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd7 expref: 29 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.035466:0:6293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.035504:0:6293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd7 expref: 29 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.035519:0:6293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd7 expref: 29 pid: 6294 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403356.035545:0:6293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72f05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260860288:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403356.035640:0:6293:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ad540 going to sleep for 11 seconds 00000100:00100000:1.0:1784403356.039420:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403356.039541:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240915456 00000100:00100000:0.0:1784403356.039551:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240915456 00000100:00100000:0.0:1784403356.039608:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:0.0:1784403356.039618:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+30:5573:x1871082240915456:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784403356.039986:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:5573:x1871082240915456:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 368us (575us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1784403356.039995:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:2.0:1784403356.040661:0:6293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72f05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260860288:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403356.040689:0:6293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403356.043736:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403356.043908:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240915584 00000100:00100000:2.0:1784403356.043919:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240915584 00010000:00010000:2.0:1784403356.043964:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd7 expref: 31 pid: 6294 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403356.044010:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:2.0:1784403356.044020:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:2360:x1871082240915584:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403356.044052:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403356.044060:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd7 expref: 31 pid: 6294 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.044074:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd7 expref: 31 pid: 6294 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.044123:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afad1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebd7 expref: 31 pid: 6294 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.044142:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:2.0:1784403356.044147:0:6278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.044157:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.044165:0:6278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.044201:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403356.044254:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+30:2360:x1871082240915584:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 235us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403356.044262:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00010000:00010000:3.0:1784403356.044677:0:6293:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.044687:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.044719:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.044727:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.044734:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.044740:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403356.044744:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.044751:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.044761:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:3.0:1784403356.044764:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403356.044768:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.044774:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afad7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403356.044833:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:10482:x1871082240915200:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 9490us (9750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403356.044850:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:0.0:1784403356.049070:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.049401:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240915840 00000100:00100000:1.0:1784403356.049413:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240915840 00000100:00100000:1.0:1784403356.049472:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1784403356.049484:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:10482:x1871082240915840:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403356.049752:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+30:10482:x1871082240915840:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 270us (692us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1784403356.049760:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:2.0:1784403356.119987:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403356.120088:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240916096 00000100:00100000:0.0:1784403356.120110:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240916096 00000100:00100000:0.0:1784403356.120172:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 94 00000100:00100000:0.0:1784403356.120182:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+30:10493:x1871082240916096:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:0.0:1784403356.120218:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403356.120242:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afad81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebf3 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120331:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afad88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120347:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afad88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120360:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afad88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120376:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afad8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120383:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afad8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120389:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afad8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120730:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afad96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120741:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afad96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120760:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afad96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403356.120770:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1784403356.120859:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afad88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120909:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afad88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120915:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afad88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120922:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403356.120926:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afad88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120939:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afad88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120951:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403356.120954:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403356.120959:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afad88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120965:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afad88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120982:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afad8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.120988:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afad8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.121000:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afad8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.121006:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403356.121008:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afad8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.121015:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afad8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.121023:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a4884d200) 00010000:00010000:0.0:1784403356.121026:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403356.121029:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afad8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.121035:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afad8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.121084:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afad81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebf3 expref: 33 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.121099:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afad96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebf3 expref: 32 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.121107:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:0.0:1784403356.121109:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403356.121111:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4800, rc 0) 00000100:00100000:0.0:1784403356.121171:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+32:10493:x1871082240916096:12345-192.168.204.28@tcp:101:cat.0 Request processed in 989us (1192us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1784403356.121187:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 94 00000100:00100000:2.0:1784403356.130159:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.130277:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240916352 00000100:00100000:1.0:1784403356.130286:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240916352 00000100:00100000:1.0:1784403356.130444:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:1.0:1784403356.130454:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+32:10493:x1871082240916352:12345-192.168.204.28@tcp:35:cat.0 00000100:00100000:1.0:1784403356.130695:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+33:10493:x1871082240916352:12345-192.168.204.28@tcp:35:cat.0 Request processed in 241us (544us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1784403356.130703:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:2.0:1784403356.169093:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.169251:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240916608 00000100:00100000:1.0:1784403356.169262:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240916608 00000100:00100000:1.0:1784403356.169347:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:1.0:1784403356.169357:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+33:10494:x1871082240916608:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1784403356.169429:0:10011:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784403356.169457:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afad96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebf3 expref: 33 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.169481:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afad6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebec expref: 32 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.169495:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afad34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebde expref: 31 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.169505:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:1.0:1784403356.169516:0:10011:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784403356.169538:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afada4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.169553:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afada4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.169563:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afada4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.169577:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.169584:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.169591:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.171182:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afadb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.171201:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afadb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.171212:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afadb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784403356.177375:0:10011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1784403356.177395:0:10011:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361745528141ns, next at 362745523586ns, rc = 0 00010000:00010000:1.0:1784403356.177486:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177505:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177519:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177529:0:10011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177535:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177541:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177568:0:10011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403356.177592:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afadb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177607:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afadb2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177614:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afadb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177620:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403356.177624:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afadb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177642:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afadb2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177657:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0a00) 00010000:00010000:1.0:1784403356.177660:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784403356.177665:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afadb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177671:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afadb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177691:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afada4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177697:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afada4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177702:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afada4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177707:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403356.177716:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afada4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.177722:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afada4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.177843:0:8813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784403356.177849:0:8813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.177858:0:8813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1e00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:2.0:1784403356.177860:0:8813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.177893:0:8813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.177903:0:8813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c8a51bd0a00) 00010000:00010000:2.0:1784403356.177905:0:8813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784403356.177908:0:8813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.177914:0:8813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afadb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.177931:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403356.177933:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403356.177935:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403356.178358:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:1.0:1784403356.178360:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403356.178364:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afada4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.178374:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afada4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784403356.178394:0:10011:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf709b87 reply state 000000001b588901 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403356.178404:0:10011:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784403356.178513:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+32:10494:x1871082240916608:12345-192.168.204.28@tcp:36:rm.0 Request processed in 9153us (9427us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1784403356.178527:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 95 00010000:00010000:1.0:1784403356.181694:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.181713:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.181721:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.181726:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403356.181731:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.181756:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.181773:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a51bd0d00) 00010000:00010000:1.0:1784403356.181776:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403356.181781:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.181788:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afadab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403356.225096:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403356.225303:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240916864 00000100:00100000:0.0:1784403356.225313:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240916864 00000100:00100000:0.0:1784403356.225386:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 96 00000100:00100000:0.0:1784403356.225398:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:10500:x1871082240916864:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403356.225423:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403356.225446:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afadc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ebfa expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.225594:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.225611:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.225624:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.225640:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.225647:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.225654:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784403356.226284:0:6294:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1784403356.226477:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226497:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226506:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226550:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226559:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadc7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226567:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226574:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403356.226578:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226586:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226600:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403356.226604:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403356.226609:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadc7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226616:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadc7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784403356.226629:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008830ba9f reply state 000000006aa29eab transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403356.226646:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784403356.226679:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afadc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebfa expref: 34 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226694:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebfa expref: 33 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.226701:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a4884db00) 00010000:00010000:0.0:1784403356.226703:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403356.226705:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5400, rc 0) 00000100:00100000:0.0:1784403356.226775:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:10500:x1871082240916864:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1379us (1695us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1784403356.226784:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 96 00010000:00010000:3.0:1784403356.233970:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.233989:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.233998:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.234005:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403356.234010:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.234018:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.234035:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a4884d200) 00010000:00010000:3.0:1784403356.234038:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403356.234043:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.234050:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afadce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403356.237012:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403356.237251:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240916992 00000100:00100000:3.0:1784403356.237261:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240916992 00000100:00100000:3.0:1784403356.237361:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:3.0:1784403356.237373:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240916992:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403356.237391:0:8571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403356.237426:0:8571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afade3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec01 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784403356.237453:0:8571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403356.237473:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1784403356.237478:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403356.237489:0:8571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afade3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec01 expref: 6 pid: 8571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.237509:0:8571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afade3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec01 expref: 6 pid: 8571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.237528:0:8571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6800, rc 0) 00000100:00100000:3.0:1784403356.237593:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240916992:12345-192.168.204.28@tcp:101:bash.0 Request processed in 222us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403356.237601:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00080000:1.0:1784403356.237733:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784403356.241789:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403356.241934:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240917120 00000100:00100000:3.0:1784403356.241944:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240917120 00000100:00100000:3.0:1784403356.242007:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:3.0:1784403356.242017:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:10500:x1871082240917120:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403356.242038:0:7101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403356.242061:0:7101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec08 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.242114:0:7101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afade3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec01 expref: 7 pid: 8571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.242141:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403356.242146:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403356.242152:0:7101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 7 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.242190:0:7101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afade3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec01 expref: 7 pid: 8571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.242205:0:7101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afade3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec01 expref: 7 pid: 8571 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403356.242220:0:7101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7101:1871082260860416:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403356.242330:0:7101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a75ff5900 going to sleep for 11 seconds 00000100:00100000:3.0:1784403356.245306:0:7101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7101:1871082260860416:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403356.245347:0:7101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 7 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.245368:0:7101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7c00, rc 0) 00000100:00100000:3.0:1784403356.245432:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:10500:x1871082240917120:12345-192.168.204.28@tcp:101:bash.0 Request processed in 3415us (3654us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403356.245441:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:2.0:1784403356.248063:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403356.248151:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240917248 00000100:00100000:3.0:1784403356.248160:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240917248 00010000:00010000:3.0:1784403356.248204:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afade3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec01 expref: 7 pid: 8571 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403356.248264:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:3.0:1784403356.248276:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240917248:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403356.248293:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403356.248331:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afade3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec01 expref: 7 pid: 8571 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.248347:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afade3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec01 expref: 7 pid: 8571 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.248372:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afade3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec01 expref: 7 pid: 8571 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.248390:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403356.248395:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403356.248403:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 6 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.248415:0:6277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 6 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.248458:0:6277:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 6 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403356.248472:0:6277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6277:1871082260860544:192.168.204.28@tcp:105: 00000100:00100000:3.0:1784403356.248699:0:6277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a75ff5900 going to sleep for 11 seconds 00000100:00100000:2.0:1784403356.252376:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403356.252476:0:6277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6277:1871082260860544:192.168.204.28@tcp:105: 00010000:00010000:3.0:1784403356.252503:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403356.252558:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240917248:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 4284us (4506us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403356.252569:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:0.0:1784403356.253182:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240917504 00000100:00100000:0.0:1784403356.253191:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240917504 00000100:00100000:0.0:1784403356.253237:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:0.0:1784403356.253245:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+33:10500:x1871082240917504:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1784403356.253659:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:10500:x1871082240917504:12345-192.168.204.28@tcp:35:bash.0 Request processed in 414us (1291us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1784403356.253667:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:2.0:1784403356.408361:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403356.408489:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240917632 00000100:00100000:3.0:1784403356.408501:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240917632 00000100:00100000:3.0:1784403356.408565:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:3.0:1784403356.408575:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:10516:x1871082240917632:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403356.408603:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403356.408625:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afadf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec0f expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.408690:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afadf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.408706:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afadf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.408718:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afadf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403356.408793:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1784403356.408797:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403356.408822:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afadf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.408847:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afadf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec0f expref: 36 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.408917:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afadf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec0f expref: 35 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.408926:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:3.0:1784403356.408929:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784403356.408932:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:3.0:1784403356.408998:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+35:10516:x1871082240917632:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 423us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403356.409005:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:2.0:1784403356.414588:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403356.415371:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240917888 00000100:00100000:0.0:1784403356.415392:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240917888 00000100:00100000:0.0:1784403356.415764:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:0.0:1784403356.415776:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+35:10516:x1871082240917888:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403356.415800:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403356.415836:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec16 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.415972:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afae06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.415985:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afae06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.415996:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afae06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403356.416009:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784403356.416134:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afadff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec16 expref: 38 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.416155:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afae06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec16 expref: 37 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.416166:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a4884db00) 00010000:00010000:0.0:1784403356.416169:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403356.416172:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4600, rc 0) 00000100:00100000:0.0:1784403356.416698:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+37:10516:x1871082240917888:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 920us (2116us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1784403356.416707:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:2.0:1784403356.421968:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.422351:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240918016 00000100:00100000:1.0:1784403356.422361:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240918016 00000100:00100000:1.0:1784403356.422420:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:1.0:1784403356.422428:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+37:2361:x1871082240918016:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403356.422441:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403356.422581:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afae06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec16 expref: 37 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.422604:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a4884db00) 00010000:00010000:1.0:1784403356.422609:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403356.422745:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:2361:x1871082240918016:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 316us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403356.422755:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:2.0:1784403356.435308:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403356.435707:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240918272 00000100:00100000:3.0:1784403356.435718:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240918272 00000100:00100000:3.0:1784403356.436539:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00100000:3.0:1784403356.436558:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:10516:x1871082240918272:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403356.436596:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403356.436619:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afae14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec1d expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.436720:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afae1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.436737:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afae1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.436752:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afae1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403356.436763:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784403356.436934:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afae14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec1d expref: 39 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.436953:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afae1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec1d expref: 38 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.436961:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a4884db00) 00010000:00010000:3.0:1784403356.436965:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784403356.436968:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403356.437043:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+38:10516:x1871082240918272:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 491us (1754us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1784403356.437051:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00100000:2.0:1784403356.451493:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403356.451601:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240918400 00000100:00100000:3.0:1784403356.451612:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240918400 00000100:00100000:3.0:1784403356.451675:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:3.0:1784403356.451684:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240918400:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:3.0:1784403356.451734:0:8571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.451756:0:8571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 6 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.451764:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1784403356.451768:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784403356.451772:0:8571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.451807:0:8571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 6 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.451834:0:8571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 6 pid: 7101 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403356.451848:0:8571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8571:1871082260860672:192.168.204.28@tcp:104: 00000100:00100000:1.0:1784403356.452249:0:8571:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a75ff5300 going to sleep for 11 seconds 00000100:00100000:2.0:1784403356.456906:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403356.457065:0:7107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240918528 00000100:00100000:0.0:1784403356.457074:0:7107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240918528 00002000:00100000:0.0:1784403356.457136:0:7107:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8c8a737ef100 x1871082240918528/t0(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:127/0 lens 504/0 e 0 to 0 dl 1784403367 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784403356.457147:0:7107:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a737ef100 with x1871082240918528 ext(0->8) 00010000:00010000:0.0:1784403356.457164:0:7107:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 7 pid: 7101 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.457182:0:7107:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 7 pid: 7101 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784403356.457190:0:7107:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c8a737ef100 00000100:00100000:0.0:1784403356.457344:0:7107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:0.0:1784403356.457355:0:7107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240918528:12345-192.168.204.28@tcp:4:lfs.0 00000100:00100000:1.0:1784403356.458055:0:8571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8571:1871082260860672:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403356.458103:0:8571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403356.458485:0:7107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2360:x1871082240918528:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 1130us (1625us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784403356.458496:0:7107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00002000:00100000:0.0:1784403356.458506:0:7107:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8c8a737ef100 x1871082240918528/t4294967302(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:127/0 lens 504/448 e 0 to 0 dl 1784403367 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784403356.458514:0:7107:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a737ef100 with x1871082240918528 ext(0->8) 00010000:00010000:0.0:1784403356.458522:0:7107:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 9 pid: 7101 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.458537:0:7107:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 9 pid: 7101 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784403356.458543:0:7107:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c8a737ef100 00000100:00100000:2.0:1784403356.465040:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403356.465130:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240918656 00000100:00100000:3.0:1784403356.465139:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240918656 00010000:00010000:3.0:1784403356.465179:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 9 pid: 7101 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403356.465222:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:3.0:1784403356.465232:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2360:x1871082240918656:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403356.465249:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784403356.465269:0:6277:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784403356.465272:0:6277:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784403356 00002000:00010000:3.0:1784403356.465274:0:6277:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784403356 00002000:00010000:3.0:1784403356.465276:0:6277:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1784403356 00010000:00010000:3.0:1784403356.465283:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 9 pid: 7101 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.465309:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 9 pid: 7101 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.465337:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61ad1ec/0x6828175665afadea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec08 expref: 9 pid: 7101 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.465376:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784403356.465380:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784403356.465397:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.465407:0:6277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.465444:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403356.465551:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240918656:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 319us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403356.465562:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00010000:00010000:1.0:1784403356.466018:0:8571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.466030:0:8571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.466059:0:8571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.466068:0:8571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.466077:0:8571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.466085:0:8571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403356.466090:0:8571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.466100:0:8571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.466114:0:8571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.466131:0:8571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a1926cc/0x6828175665afae29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403356.466187:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240918400:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 14503us (14712us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403356.466195:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:2.0:1784403356.474823:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.474988:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240918912 00000100:00100000:1.0:1784403356.475000:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240918912 00000100:00100000:1.0:1784403356.475051:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:1.0:1784403356.475062:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497ad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+38:10516:x1871082240918912:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:1.0:1784403356.475140:0:6296:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afae1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec1d expref: 38 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403356.475455:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1784403356.475502:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1784403356.475953:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1784403356.476009:0:6296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.476025:0:6296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebfa expref: 42 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.476035:0:6296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.476071:0:6296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebfa expref: 42 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.476098:0:6296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebfa expref: 42 pid: 6294 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403356.476112:0:6296:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6296:1871082260860800:192.168.204.28@tcp:104: 00000100:00100000:1.0:1784403356.476191:0:6296:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a453500c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403356.479596:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.479637:0:6296:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6296:1871082260860800:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403356.479673:0:6296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403356.479994:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240919040 00000100:00100000:0.0:1784403356.480001:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240919040 00010000:00010000:0.0:1784403356.480038:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebfa expref: 43 pid: 6294 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403356.480096:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:0.0:1784403356.480108:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+43:2361:x1871082240919040:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403356.480137:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403356.480145:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebfa expref: 43 pid: 6294 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.480158:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebfa expref: 43 pid: 6294 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.480183:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afadd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebfa expref: 43 pid: 6294 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.480199:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a4884db00) 00010000:00010000:0.0:1784403356.480204:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.480213:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.480220:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.480251:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403356.480325:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+42:2361:x1871082240919040:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 218us (742us total) trans 0 rc 0/0 00010000:00010000:1.0:1784403356.480330:0:6296:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403356.480332:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00010000:00010000:1.0:1784403356.480337:0:6296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403356.480616:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1784403356.484148:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1784403356.484368:0:6296:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6296:1871082260860928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784403356.486425:0:6296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403356.486473:0:6296:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45350cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403356.486564:0:6298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260860928 00000100:00100000:3.0:1784403356.486574:0:6298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260860928 00000100:00100000:3.0:1784403356.486652:0:6298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784403356.486662:0:6298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6296:x1871082260860928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784403356.486771:0:6298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6296:x1871082260860928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403356.486778:0:6298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784403356.487016:0:6296:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1784403356.487022:0:6296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1784403356.487040:0:6296:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a81b5b100, transno 4294967301 00000100:00100000:2.0:1784403356.487056:0:6296:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6296:1871082260860928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1784403356.487539:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1784403356.487616:0:6296:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737eed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6296:1871082260861056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784403356.487776:0:6296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403356.487794:0:6296:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a489a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1784403356.488015:0:6298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260861056 00000100:00100000:3.0:1784403356.488021:0:6298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260861056 00000100:00100000:3.0:1784403356.488054:0:6298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784403356.488061:0:6298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6296:x1871082260861056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784403356.488220:0:6298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6296:x1871082260861056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (445us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784403356.488234:0:6298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1784403356.488441:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784403356.489633:0:6296:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737eed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6296:1871082260861056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1784403356.489819:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1784403356.489904:0:6296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.489916:0:6296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.489924:0:6296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.489930:0:6296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403356.489934:0:6296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.489943:0:6296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.489959:0:6296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a4884db00) 00010000:00010000:2.0:1784403356.489974:0:6296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784403356.489980:0:6296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403356.489987:0:6296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afae30 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784403356.490185:0:6296:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784403356.490303:0:6296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1784403356.490314:0:6296:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362058447919ns, next at 363058446128ns, rc = 0 00000001:00080000:2.0:1784403356.490322:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1784403356.490355:0:6296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a4884db00) 00010000:00010000:2.0:1784403356.490359:0:6296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784403356.490368:0:6296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afae1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec1d expref: 46 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403356.491073:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497ad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+45:10516:x1871082240918912:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 16009us (16256us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1784403356.491084:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 26 00000020:00080000:2.0:1784403356.491090:0:6296:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784403356.498264:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.498424:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240919168 00000100:00100000:1.0:1784403356.498433:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240919168 00000100:00100000:1.0:1784403356.498547:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 100 00000100:00100000:1.0:1784403356.498557:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+45:10516:x1871082240919168:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403356.498587:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403356.498627:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afae37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec24 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.498704:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afae37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec24 expref: 46 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.498720:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afae37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec24 expref: 46 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.498742:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:1.0:1784403356.498745:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784403356.498748:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0800, rc 0) 00000100:00100000:1.0:1784403356.498813:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+46:10516:x1871082240919168:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 257us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403356.498821:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 100 00000100:00100000:2.0:1784403356.508154:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.508423:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240919424 00000100:00100000:1.0:1784403356.508433:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240919424 00000100:00100000:1.0:1784403356.508541:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:1.0:1784403356.508553:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+46:10516:x1871082240919424:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403356.508814:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:10516:x1871082240919424:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 262us (670us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1784403356.508822:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00010000:00010000:1.0:1784403356.511801:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403356.627725:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.627826:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240919552 00000100:00100000:1.0:1784403356.627837:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240919552 00000100:00100000:1.0:1784403356.627941:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00100000:1.0:1784403356.627951:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:10526:x1871082240919552:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:1.0:1784403356.628045:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afae3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628064:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afae3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628075:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afae3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628091:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afae45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628099:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afae45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628106:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afae45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628231:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628240:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628247:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784403356.628300:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628313:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afae3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628330:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afae3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628337:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afae3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628343:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403356.628347:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afae3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628353:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afae3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628366:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:1.0:1784403356.628369:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403356.628374:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afae3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628380:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afae3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628395:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afae45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628401:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afae45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628407:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afae45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628411:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403356.628422:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afae45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628427:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afae45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628434:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a51bd0800) 00010000:00010000:1.0:1784403356.628437:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403356.628440:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afae45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628445:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afae45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628460:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628467:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628473:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628478:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403356.628481:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628493:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628501:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:1.0:1784403356.628504:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403356.628515:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.628521:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403356.628613:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:10526:x1871082240919552:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 662us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403356.628621:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00100000:3.0:1784403356.677516:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403356.677714:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240919808 00000100:00100000:0.0:1784403356.677743:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240919808 00000100:00100000:0.0:1784403356.677822:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:0.0:1784403356.677834:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:10529:x1871082240919808:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403356.677859:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403356.677907:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afae53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec2b expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.677983:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afae5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678000:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afae5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678012:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afae5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678027:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678034:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678040:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678174:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afae68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678184:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afae68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678192:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afae68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403356.678224:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784403356.678340:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afae5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678349:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afae5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678355:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afae5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678362:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403356.678366:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afae5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678374:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afae5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678386:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403356.678389:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403356.678393:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afae5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678400:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afae5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678413:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678419:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678435:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678440:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403356.678443:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678449:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678458:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a4884d000) 00010000:00010000:0.0:1784403356.678461:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403356.678464:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678470:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678515:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afae53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec2b expref: 50 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678530:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afae68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec2b expref: 49 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.678538:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:0.0:1784403356.678540:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403356.678543:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4800, rc 0) 00000100:00100000:0.0:1784403356.678625:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+49:10529:x1871082240919808:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 793us (1128us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1784403356.678642:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:2.0:1784403356.684406:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.684503:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240919936 00000100:00100000:1.0:1784403356.684513:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240919936 00000100:00100000:1.0:1784403356.684583:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 103 00000100:00100000:1.0:1784403356.684594:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+49:10529:x1871082240919936:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:1.0:1784403356.684673:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.684693:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.684704:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.684730:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.684736:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.684742:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.684747:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403356.684774:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.684782:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.684794:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:1.0:1784403356.684797:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784403356.684802:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.684809:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403356.684922:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+49:10529:x1871082240919936:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 329us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403356.684930:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 103 00000100:00100000:2.0:1784403356.688030:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.688182:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240920192 00000100:00100000:1.0:1784403356.688193:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240920192 00000100:00100000:1.0:1784403356.688263:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:1.0:1784403356.688273:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+49:10529:x1871082240920192:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403356.688513:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+50:10529:x1871082240920192:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 239us (491us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1784403356.688521:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:2.0:1784403356.802581:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403356.802699:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240920448 00000100:00100000:0.0:1784403356.802711:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240920448 00000100:00100000:0.0:1784403356.802782:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 104 00000100:00100000:0.0:1784403356.802791:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+50:10539:x1871082240920448:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403356.802820:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403356.802823:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784403356.802854:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afadf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec0f expref: 50 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.802903:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403356.802910:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403356.802933:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afae7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec32 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.803409:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.803424:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.803435:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403356.803446:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784403356.803581:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afae7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec32 expref: 52 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.803617:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec32 expref: 51 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.803626:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:0.0:1784403356.803629:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403356.803632:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5000, rc 0) 00000100:00100000:0.0:1784403356.803703:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:10539:x1871082240920448:12345-192.168.204.28@tcp:101:bash.0 Request processed in 911us (1131us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1784403356.804944:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 104 00000100:00100000:2.0:1784403356.811315:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.812215:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240920704 00000100:00100000:1.0:1784403356.812235:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240920704 00000100:00100000:1.0:1784403356.812334:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 105 00000100:00100000:1.0:1784403356.812347:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:10539:x1871082240920704:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1784403356.812451:0:10011:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784403356.812507:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afae84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec32 expref: 51 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.812535:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afae68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec2b expref: 50 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.812546:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:1.0:1784403356.812552:0:10011:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784403356.812825:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.812842:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.812853:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403356.812963:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1784403356.812992:0:10011:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050c93521 reply state 00000000805d3331 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403356.813002:0:10011:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784403356.813130:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:10539:x1871082240920704:12345-192.168.204.28@tcp:36:bash.0 Request processed in 785us (1845us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1784403356.813140:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 105 00000020:00080000:1.0:1784403356.813147:0:10011:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784403356.821337:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.821369:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.821406:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.821413:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403356.821419:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.821428:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.821449:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:1.0:1784403356.821452:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403356.821458:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.821465:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403356.831781:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.831912:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240920832 00000100:00100000:1.0:1784403356.831929:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240920832 00000100:00100000:1.0:1784403356.832017:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 106 00000100:00100000:1.0:1784403356.832029:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:10539:x1871082240920832:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1784403356.832071:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403356.832099:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec39 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.832243:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.832261:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.832282:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403356.832333:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784403356.832337:0:6292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403356.832360:0:6292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.832388:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afae99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec39 expref: 53 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.832408:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec39 expref: 52 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.832416:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:1.0:1784403356.832419:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403356.832423:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0200, rc 0) 00000100:00100000:1.0:1784403356.832519:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:10539:x1871082240920832:12345-192.168.204.28@tcp:101:bash.0 Request processed in 491us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403356.832526:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 106 00000100:00100000:2.0:1784403356.844003:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.844140:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240921088 00000100:00100000:1.0:1784403356.844154:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240921088 00000100:00100000:1.0:1784403356.844231:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:1.0:1784403356.844243:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:10539:x1871082240921088:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1784403356.844593:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+53:10539:x1871082240921088:12345-192.168.204.28@tcp:35:bash.0 Request processed in 352us (606us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1784403356.844602:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:2.0:1784403356.948093:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.948302:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240921216 00000100:00100000:1.0:1784403356.948315:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240921216 00000100:00100000:1.0:1784403356.948394:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 107 00000100:00100000:1.0:1784403356.948406:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+53:10545:x1871082240921216:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403356.948442:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403356.948471:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afaea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec40 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.948567:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afaeae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.948584:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afaeae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.948599:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afaeae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403356.948682:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1784403356.948687:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403356.948717:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afaeae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.948746:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afaea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec40 expref: 55 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.948771:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afaeae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec40 expref: 54 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.948782:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:1.0:1784403356.948786:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784403356.948799:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1200, rc 0) 00000100:00100000:1.0:1784403356.948954:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:10545:x1871082240921216:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 549us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403356.948962:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 107 00000100:00100000:2.0:1784403356.956838:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.956997:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240921344 00000100:00100000:1.0:1784403356.957010:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240921344 00000100:00100000:1.0:1784403356.957099:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 108 00000100:00100000:1.0:1784403356.957112:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:10545:x1871082240921344:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403356.957143:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403356.957175:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afaeb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec47 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957263:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afaebc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957293:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afaebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957307:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afaebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957326:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957334:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957340:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957477:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afaeca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957518:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afaeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957527:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afaeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403356.957579:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784403356.957584:0:6292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403356.957609:0:6292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afaeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957624:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afaeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957634:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afaebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957640:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afaebc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957648:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afaebc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957655:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403356.957660:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afaebc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957668:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afaebc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957683:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:1.0:1784403356.957686:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403356.957698:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afaebc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957706:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afaebc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957723:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957729:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaec3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957736:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957742:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403356.957745:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957750:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957758:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a51bd0800) 00010000:00010000:1.0:1784403356.957760:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403356.957763:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaec3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957770:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957806:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afaeb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec47 expref: 56 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957834:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afaeca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec47 expref: 55 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.957842:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:1.0:1784403356.957844:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403356.957847:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0600, rc 0) 00000100:00100000:1.0:1784403356.958017:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10545:x1871082240921344:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 907us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403356.958026:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 108 00000100:00100000:2.0:1784403356.965291:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403356.965403:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240921472 00000100:00100000:0.0:1784403356.965415:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240921472 00000100:00100000:0.0:1784403356.965498:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:0.0:1784403356.965516:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:2360:x1871082240921472:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403356.965539:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403356.965573:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afaeca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec47 expref: 55 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.965598:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:0.0:1784403356.965603:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403356.965681:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:2360:x1871082240921472:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 166us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403356.965690:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:3.0:1784403356.973621:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.973742:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240921728 00000100:00100000:1.0:1784403356.973754:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240921728 00000100:00100000:1.0:1784403356.973833:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 109 00000100:00100000:1.0:1784403356.973846:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:10545:x1871082240921728:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403356.973917:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403356.973945:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afaed1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec4e expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.974091:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.974110:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec39 expref: 55 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.974120:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.974160:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec39 expref: 55 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.974192:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec39 expref: 55 pid: 6292 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403356.974208:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260861184:192.168.204.28@tcp:104: 00000100:00100000:1.0:1784403356.974334:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45350600 going to sleep for 11 seconds 00000100:00100000:2.0:1784403356.978012:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403356.978112:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240921856 00000100:00100000:0.0:1784403356.978125:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240921856 00010000:00010000:0.0:1784403356.978183:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec39 expref: 56 pid: 6292 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403356.978257:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:0.0:1784403356.978269:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+56:2360:x1871082240921856:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403356.978302:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403356.978310:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec39 expref: 56 pid: 6292 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.978326:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec39 expref: 56 pid: 6292 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.978355:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:0.0:1784403356.978360:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.978372:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.978380:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403356.978408:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784403356.978689:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec39 expref: 56 pid: 6292 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403356.978710:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260861184:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403356.978737:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.978747:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.978753:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403356.978777:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784403356.979027:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afaed1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec4e expref: 57 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.979044:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec4e expref: 56 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.979053:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:1.0:1784403356.979068:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784403356.979071:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0c00, rc 0) 00000100:00100000:0.0:1784403356.979600:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+56:2360:x1871082240921856:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1328us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403356.979612:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:1.0:1784403356.980215:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10545:x1871082240921728:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6369us (6754us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1784403356.980224:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 109 00000100:00100000:3.0:1784403356.983714:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403356.983804:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240922112 00000100:00100000:0.0:1784403356.983818:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240922112 00000100:00100000:1.0:1784403356.983927:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:1.0:1784403356.983943:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10545:x1871082240922112:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:1.0:1784403356.983964:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403356.983996:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afae37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec24 expref: 55 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.984018:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:1.0:1784403356.984023:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403356.985452:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:10545:x1871082240922112:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 1502us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403356.985477:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1784403356.989490:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403356.989576:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240922240 00000100:00100000:1.0:1784403356.989595:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240922240 00000100:00100000:1.0:1784403356.989689:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 110 00000100:00100000:1.0:1784403356.989702:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:10545:x1871082240922240:12345-192.168.204.28@tcp:58:lfs.0 00010000:00010000:1.0:1784403356.989847:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.990052:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403356.990069:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784403356.990418:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1784403356.990597:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:10545:x1871082240922240:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 895us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403356.990608:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 110 00000100:00100000:2.0:1784403356.994119:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403356.994242:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240922368 00000100:00100000:3.0:1784403356.994255:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240922368 00000100:00100000:3.0:1784403356.994348:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 111 00000100:00100000:3.0:1784403356.994361:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:10545:x1871082240922368:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403356.994388:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403356.994414:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaeed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec55 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.994490:0:6293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.994504:0:6293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaeed lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec55 expref: 55 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.994529:0:6293:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.994549:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaeed lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec55 expref: 55 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.994565:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:3.0:1784403356.994585:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403356.994590:0:6293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaeed lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec55 expref: 55 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403356.994599:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7c00, rc 0) 00000100:00100000:3.0:1784403356.994682:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10545:x1871082240922368:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 323us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403356.994690:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 111 00000100:00100000:0.0:1784403357.248224:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.248287:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.248347:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.248388:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.248435:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240922624 00000100:00100000:0.0:1784403357.248447:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240922624 00000100:00100000:0.0:1784403357.248528:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240922752 00000100:00100000:0.0:1784403357.248532:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240922752 00000100:00100000:0.0:1784403357.248555:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:0.0:1784403357.248567:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2361:x1871082240922624:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403357.248771:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2361:x1871082240922624:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 205us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.248779:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:0.0:1784403357.248799:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:0.0:1784403357.248805:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240922752:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403357.248831:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240922752:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.248836:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00080000:0.0:1784403357.248853:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403357.248968:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240922496 00000100:00100000:1.0:1784403357.248972:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240922496 00000100:00100000:1.0:1784403357.249005:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 291 00000100:00100000:1.0:1784403357.249011:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2361:x1871082240922496:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403357.249040:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2361:x1871082240922496:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 29us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403357.249047:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 291 00000100:00100000:2.0:1784403357.249147:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240922880 00000100:00100000:2.0:1784403357.249152:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240922880 00000100:00080000:1.0:1784403357.257469:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403357.258062:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 139 00000100:00100000:3.0:1784403357.258086:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2361:x1871082240922880:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403357.258227:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2361:x1871082240922880:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 153us (9948us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403357.258236:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 139 00000040:00080000:2.0:1784403357.279133:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784403357.279149:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784403357.279199:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1784403357.279207:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784403357.279408:0:12049:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a4302ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260861312:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784403357.279563:0:12049:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a489a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403357.285400:0:12049:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a4302ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260861312:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784403357.288034:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403357.288487:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240923008 00000100:00100000:3.0:1784403357.288502:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240923008 00000100:00100000:3.0:1784403357.288585:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 112 00000100:00100000:3.0:1784403357.288598:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10546:x1871082240923008:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784403357.288643:0:6293:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784403357.288792:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10546:x1871082240923008:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 196us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403357.288801:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 112 00000100:00100000:1.0:1784403357.296794:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.296892:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240923136 00000100:00100000:0.0:1784403357.296904:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240923136 00000100:00100000:0.0:1784403357.297023:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:0.0:1784403357.297035:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10546:x1871082240923136:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784403357.297142:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaef4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297164:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaef4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297178:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaef4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297216:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaefb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297225:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaefb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297231:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaefb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297262:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297272:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297364:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403357.297417:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784403357.297423:0:6292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403357.297439:0:6292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297453:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaef4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297461:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaef4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297469:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaef4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297492:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403357.297497:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaef4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297507:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaef4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297523:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:0.0:1784403357.297527:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403357.297533:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaef4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297540:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afaef4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297557:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaefb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297563:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaefb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297569:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaefb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297575:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403357.297578:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaefb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297585:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaefb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297605:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8c8a4884d000) 00010000:00010000:0.0:1784403357.297607:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403357.297610:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaefb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297616:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaefb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297632:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297638:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297644:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297650:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403357.297653:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297658:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297665:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:0.0:1784403357.297668:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403357.297671:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.297677:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.297795:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10546:x1871082240923136:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 Request processed in 760us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.297805:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:2.0:1784403357.306325:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403357.306467:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240923392 00000100:00100000:3.0:1784403357.306479:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240923392 00000100:00100000:3.0:1784403357.306552:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:3.0:1784403357.306563:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:10546:x1871082240923392:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403357.306590:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403357.306630:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf09 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec5c expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.306757:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.306775:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.306788:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403357.306800:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784403357.306967:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.306976:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.306983:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.306990:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403357.306995:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.307003:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.307018:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:3.0:1784403357.307021:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784403357.307026:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.307044:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.307096:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf09 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec5c expref: 57 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.307108:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:3.0:1784403357.307111:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403357.307115:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf09 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec5c expref: 57 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.307125:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7e00, rc 0) 00000100:00100000:3.0:1784403357.307193:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+56:10546:x1871082240923392:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 631us (882us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1784403357.307201:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:2.0:1784403357.313501:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403357.313583:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240923520 00000100:00100000:3.0:1784403357.313596:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240923520 00000100:00100000:3.0:1784403357.313666:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:3.0:1784403357.313677:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+56:10546:x1871082240923520:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784403357.313723:0:6294:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784403357.313852:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+56:10546:x1871082240923520:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 177us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403357.313861:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:2.0:1784403357.319982:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403357.320247:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240923776 00000100:00100000:1.0:1784403357.320260:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240923776 00000100:00100000:1.0:1784403357.320349:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:1.0:1784403357.320361:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+56:10546:x1871082240923776:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403357.320390:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403357.320394:0:10011:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784403357.320426:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afaeae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec40 expref: 56 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.320451:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:1.0:1784403357.320456:0:10011:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784403357.320470:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afaf1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec63 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784403357.321045:0:10011:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1784403357.324422:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afaf25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.324451:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afaf25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.324467:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afaf25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.324578:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afaf1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec63 expref: 58 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.324600:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afaf25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec63 expref: 57 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.324610:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:1.0:1784403357.324612:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403357.324616:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1800, rc 0) 00000100:00100000:1.0:1784403357.324695:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:10546:x1871082240923776:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 4335us (4727us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1784403357.324705:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:1.0:1784403357.328226:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403357.328391:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240924032 00000100:00100000:3.0:1784403357.328406:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240924032 00000100:00100000:3.0:1784403357.328479:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:3.0:1784403357.328521:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:10546:x1871082240924032:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784403357.328605:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403357.328639:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afaf25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec63 expref: 57 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328663:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a51bd0800) 00010000:00010000:3.0:1784403357.328677:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784403357.328703:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328718:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328729:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328743:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x71bede79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328749:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x71bede79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328755:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x71bede79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328903:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328911:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf33 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328930:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328937:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403357.328943:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328951:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328961:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:3.0:1784403357.328965:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403357.328969:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328976:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afaf33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328986:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x71bede79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328992:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71bede79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.328998:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71bede79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.329003:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403357.329005:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71bede79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.329021:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71bede79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.329031:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x71bede79 (ffff8c8a43245200) 00010000:00010000:3.0:1784403357.329033:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403357.329036:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x71bede79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.329041:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x71bede79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403357.329213:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+56:10546:x1871082240924032:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 694us (1001us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784403357.329222:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:2.0:1784403357.333991:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.334182:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240924160 00000100:00100000:0.0:1784403357.334197:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240924160 00000100:00100000:0.0:1784403357.334287:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:0.0:1784403357.334300:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+56:10546:x1871082240924160:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784403357.334328:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403357.334356:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec6a expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.334401:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.334417:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.334430:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.334560:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec6a expref: 58 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.334584:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec6a expref: 57 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.334593:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884d000) 00010000:00010000:0.0:1784403357.334604:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784403357.334609:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4c00, rc 0) 00000100:00100000:0.0:1784403357.334693:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:10546:x1871082240924160:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 395us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.334702:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:1.0:1784403357.338723:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403357.338911:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240924416 00000100:00100000:3.0:1784403357.338927:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240924416 00000100:00100000:3.0:1784403357.338999:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 119 00000100:00100000:3.0:1784403357.339011:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:10546:x1871082240924416:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784403357.339123:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.339146:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.339161:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784403357.339706:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1784403357.339720:0:6294:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362907853410ns, next at 363907850409ns, rc = 0 00000004:00010000:3.0:1784403357.339860:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4703261 reply state 00000000a84fc2d4 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403357.340989:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784403357.343074:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:10546:x1871082240924416:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 4051us (4353us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1784403357.343090:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 119 00010000:00010000:3.0:1784403357.353235:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.353262:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.353271:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.353289:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403357.353295:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.353303:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.353324:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884d000) 00010000:00010000:3.0:1784403357.353327:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784403357.353333:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.353340:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afaf4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403357.360422:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.361003:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240924544 00000100:00100000:0.0:1784403357.361018:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240924544 00000100:00100000:0.0:1784403357.361102:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:0.0:1784403357.361115:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:10546:x1871082240924544:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784403357.361150:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403357.361182:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec71 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.361265:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec71 expref: 59 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.361295:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec71 expref: 59 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.361319:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884d000) 00010000:00010000:0.0:1784403357.361322:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784403357.361328:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4200, rc 0) 00000100:00100000:0.0:1784403357.361409:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:10546:x1871082240924544:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 296us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.361416:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:2.0:1784403357.368734:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.368853:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240924672 00000100:00100000:0.0:1784403357.368914:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240924672 00000100:00100000:0.0:1784403357.369005:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:0.0:1784403357.369017:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2358:x1871082240924672:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784403357.369433:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2358:x1871082240924672:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 417us (713us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1784403357.369443:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:2.0:1784403357.387998:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403357.388137:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240924928 00000100:00100000:1.0:1784403357.388151:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240924928 00000100:00100000:1.0:1784403357.388233:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:1.0:1784403357.388245:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:10546:x1871082240924928:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784403357.388578:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:10546:x1871082240924928:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 333us (592us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1784403357.388588:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:2.0:1784403357.396527:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403357.396656:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240925184 00000100:00100000:3.0:1784403357.396674:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240925184 00000100:00100000:3.0:1784403357.396765:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:3.0:1784403357.396777:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:10546:x1871082240925184:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784403357.397017:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:10546:x1871082240925184:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 241us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403357.397030:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:2.0:1784403357.400003:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.400114:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240925312 00000100:00100000:0.0:1784403357.400128:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240925312 00000100:00100000:0.0:1784403357.400208:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:0.0:1784403357.400220:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:10546:x1871082240925312:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784403357.400246:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403357.400285:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afaf5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec78 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.400382:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afaf64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.400402:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afaf64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.400416:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afaf64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403357.400462:0:6292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403357.400486:0:6292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afaf64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.400519:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afaf5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec78 expref: 62 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.400567:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afaf64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec78 expref: 61 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.400577:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884d000) 00010000:00010000:0.0:1784403357.400580:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784403357.400584:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4000, rc 0) 00000100:00100000:0.0:1784403357.400663:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:10546:x1871082240925312:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 445us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.400672:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:0.0:1784403357.404510:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403357.404609:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240925440 00000100:00100000:3.0:1784403357.404621:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240925440 00000100:00100000:3.0:1784403357.404700:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:3.0:1784403357.404712:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2360:x1871082240925440:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403357.404737:0:7102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403357.404765:0:7102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afaf6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec7f expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784403357.404799:0:7102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bd59d, blocks: 0x1 00010000:00010000:3.0:1784403357.404832:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:3.0:1784403357.404837:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403357.404850:0:7102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afaf6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec7f expref: 10 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.404904:0:7102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afaf6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec7f expref: 10 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.404922:0:7102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:3.0:1784403357.404996:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:2360:x1871082240925440:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 287us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403357.405005:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:2.0:1784403357.415052:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403357.415205:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240925696 00000100:00100000:3.0:1784403357.415236:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240925696 00000100:00100000:3.0:1784403357.415327:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:3.0:1784403357.415340:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:10546:x1871082240925696:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784403357.415510:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:10546:x1871082240925696:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 164us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403357.415518:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:2.0:1784403357.420779:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.421088:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240925824 00000100:00100000:0.0:1784403357.421103:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240925824 00000100:00100000:0.0:1784403357.421183:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:0.0:1784403357.421196:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:10546:x1871082240925824:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784403357.421221:0:7101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403357.421245:0:7101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec86 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.421299:0:7101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afaf6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec7f expref: 11 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.421310:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403357.421315:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403357.421321:0:7101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 11 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.421381:0:7101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afaf6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec7f expref: 11 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.421397:0:7101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afaf6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec7f expref: 11 pid: 7102 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.421414:0:7101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73694e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7101:1871082260861440:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403357.421552:0:7101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410afa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784403357.426449:0:7101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73694e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7101:1871082260861440:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403357.426491:0:7101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 11 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.426515:0:7101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5600, rc 0) 00000100:00100000:3.0:1784403357.426655:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:10546:x1871082240925824:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 5461us (5889us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403357.426666:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:1.0:1784403357.427415:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.428207:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240925952 00000100:00100000:0.0:1784403357.428218:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240925952 00010000:00010000:0.0:1784403357.428261:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afaf6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec7f expref: 11 pid: 7102 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.428464:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:0.0:1784403357.428475:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:2361:x1871082240925952:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403357.428492:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403357.428517:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afaf6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec7f expref: 11 pid: 7102 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.428533:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afaf6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec7f expref: 11 pid: 7102 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.428557:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afaf6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec7f expref: 11 pid: 7102 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.428596:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403357.428601:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403357.428610:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 10 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.428620:0:6276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 10 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.428659:0:6276:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 10 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.428810:0:6276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73694700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6276:1871082260861568:192.168.204.28@tcp:105: 00000100:00100000:0.0:1784403357.429120:0:6276:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410af600 going to sleep for 11 seconds 00000100:00100000:2.0:1784403357.434106:0:6276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73694700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6276:1871082260861568:192.168.204.28@tcp:105: 00010000:00010000:2.0:1784403357.434145:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403357.434215:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:2361:x1871082240925952:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 5741us (6803us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403357.434230:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:2.0:1784403357.436079:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.436212:0:7106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240926080 00000100:00100000:0.0:1784403357.436227:0:7106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240926080 00002000:00100000:0.0:1784403357.436662:0:7106:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8c8a77cd4700 x1871082240926080/t0(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:128/0 lens 504/0 e 0 to 0 dl 1784403368 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784403357.436675:0:7106:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a77cd4700 with x1871082240926080 ext(0->12) 00002000:00010000:0.0:1784403357.436683:0:7106:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a77cd4700 00000100:00100000:0.0:1784403357.436717:0:7106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:0.0:1784403357.436727:0:7106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:2361:x1871082240926080:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784403357.446338:0:7106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:2361:x1871082240926080:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 Request processed in 9592us (10250us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784403357.446386:0:7106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00002000:00100000:0.0:1784403357.446407:0:7106:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8c8a77cd4700 x1871082240926080/t4294967308(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:128/0 lens 504/448 e 0 to 0 dl 1784403368 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784403357.446418:0:7106:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a77cd4700 with x1871082240926080 ext(0->12) 00002000:00010000:0.0:1784403357.446425:0:7106:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a77cd4700 00000100:00100000:2.0:1784403357.456252:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.460998:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240926208 00000100:00100000:0.0:1784403357.461023:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240926208 00000100:00100000:0.0:1784403357.461129:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 124 00000100:00100000:0.0:1784403357.461141:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:10546:x1871082240926208:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784403357.535568:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000001:00080000:1.0:1784403357.535651:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1784403357.535687:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1784403357.535734:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1784403357.535751:0:6314:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c8a7349eb40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1784403357.535758:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a4921fc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a454ad540 00000020:00080000:1.0:1784403357.535762:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a4921f900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a412ea800 00000004:00080000:1.0:1784403357.535791:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1784403357.535812:0:6314:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c8a49ca4480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1784403357.535815:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a44d0f300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a525ab180 00000020:00080000:1.0:1784403357.535818:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a44d0fc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a72e26000 00010000:00010000:0.0:1784403357.536019:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784403357.536419:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1784403357.536660:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1784403357.536674:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784403357.536701:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260861696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784403357.536797:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403357.536932:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260861824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784403357.536974:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403357.537002:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784403357.537009:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260861952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784403357.537034:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403357.537460:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260861696 00000100:00100000:0.0:1784403357.537472:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260861696 00000100:00100000:0.0:1784403357.537547:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260861824 00000100:00100000:0.0:1784403357.537550:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260861824 00000100:00100000:0.0:1784403357.537563:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260861952 00000100:00100000:0.0:1784403357.537565:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260861952 00000100:00100000:0.0:1784403357.537609:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784403357.537847:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:10546:x1871082240926208:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 Request processed in 76702us (81605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403357.537858:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 124 00000100:00080000:1.0:1784403357.537976:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403357.538165:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260861696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784403357.538203:0:8571:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1784403357.538234:0:8571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.538260:0:8571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afad3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebe5 expref: 11 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403357.538416:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784403357.538427:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3565:x1871082260861824:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1784403357.539181:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784403357.539190:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403357.539197:0:8571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.539251:0:8571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afad3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebe5 expref: 11 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.539268:0:8571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afad3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebe5 expref: 11 pid: 7101 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784403357.539400:0:7102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784403357.539404:0:7102:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784403357 00002000:00010000:1.0:1784403357.539407:0:7102:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784403357.539409:0:7102:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1784403357 -> 1784403357 00002000:00010000:1.0:1784403357.539412:0:7102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784403357.539577:0:8571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73694700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8571:1871082260862080:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403357.539673:0:8571:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410af6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403357.539897:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3565:x1871082260861824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1471us (2933us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1784403357.539907:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784403357.539937:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784403357.539950:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260861952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784403357.539990:0:7102:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1784403357.540024:0:7102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a5bd59c, atime: 0x6a5bd59c, ctime: 0x6a5bd59c, blocks: 0x1 00010000:00010000:1.0:1784403357.540032:0:7102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009deaad9b/0x6828175665afaf80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.540046:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1784403357.540062:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403357.540071:0:7102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009deaad9b/0x6828175665afaf80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.540089:0:7102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009deaad9b/0x6828175665afaf80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.540100:0:7102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009deaad9b/0x6828175665afaf80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.540109:0:7102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009deaad9b/0x6828175665afaf80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.540137:0:7102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784403357.541295:0:8813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403357.541307:0:8813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009deaad9b/0x6828175665afaf80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.541321:0:8813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1000 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403357.541337:0:8813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009deaad9b/0x6828175665afaf80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.541349:0:8813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009deaad9b/0x6828175665afaf80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.541374:0:8813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009deaad9b/0x6828175665afaf80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.541381:0:8813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009deaad9b/0x6828175665afaf80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.541407:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403357.541409:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403357.541411:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403357.541605:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3565:x1871082260861952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1655us (4565us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784403357.541635:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1784403357.543386:0:3565:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a73695c00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1784403357.543406:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260861824:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1784403357.543432:0:3565:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a73697100/2, rc 0, transno 4294967304 00000100:00100000:2.0:1784403357.543437:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260861952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784403357.553147:0:8571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73694700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8571:1871082260862080:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403357.553196:0:8571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403357.554179:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.554244:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240926336 00000100:00100000:0.0:1784403357.554256:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240926336 00000100:00100000:0.0:1784403357.554387:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:0.0:1784403357.554398:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:2361:x1871082240926336:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784403357.555700:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.555805:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240926464 00000100:00100000:0.0:1784403357.555815:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240926464 00010000:00010000:0.0:1784403357.555861:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afad3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebe5 expref: 13 pid: 7101 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.555944:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:0.0:1784403357.555955:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:2359:x1871082240926464:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403357.555975:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403357.555982:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afad3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebe5 expref: 13 pid: 7101 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.555999:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afad3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebe5 expref: 13 pid: 7101 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.556030:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afad3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebe5 expref: 13 pid: 7101 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.556618:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403357.556627:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403357.556636:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.556649:0:6278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.556691:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403357.556970:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:2359:x1871082240926464:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1012us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.556980:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 54 00010000:00010000:0.0:1784403357.557035:0:8571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.557046:0:8571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.557070:0:8571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.557080:0:8571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.557099:0:8571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784403357.559220:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3567:x1871082260861696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21050us (22413us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784403357.559236:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1784403357.559302:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403357.559312:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.559327:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5a00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403357.559333:0:6279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.559345:0:6279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.559388:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.559397:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf92650a/0x6828175665afaf79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.559425:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403357.559427:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403357.559429:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784403357.559479:0:3567:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a73695880/2, rc 0, transno 4294967310 00000100:00100000:0.0:1784403357.559487:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260861696:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1784403357.619548:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1784403357.619589:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1784403357.619942:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240926336:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 Request processed in 65534us (65760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403357.619958:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:3.0:1784403357.640718:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403357.642131:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240926720 00000100:00100000:2.0:1784403357.642150:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240926720 00000100:00100000:2.0:1784403357.642265:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:2.0:1784403357.642288:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:10546:x1871082240926720:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784403357.642365:0:6293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403357.642401:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afaf64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec78 expref: 15 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.642428:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884d000) 00010000:00010000:2.0:1784403357.642434:0:6293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403357.642495:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.642513:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.642525:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403357.642845:0:6293:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014e14553 reply state 000000009324e8dd transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403357.642857:0:6293:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784403357.643253:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:10546:x1871082240926720:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 965us (2546us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1784403357.643263:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:0.0:1784403357.651631:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1784403357.652144:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.652160:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.652180:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.652187:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403357.652193:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.652201:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.652223:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884d000) 00010000:00010000:1.0:1784403357.652226:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403357.652231:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.652238:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afaf87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403357.652437:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240926848 00000100:00100000:2.0:1784403357.652450:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240926848 00000100:00100000:2.0:1784403357.652523:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:2.0:1784403357.652536:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240926848:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784403357.652813:0:7099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784403357.652818:0:7099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1784403357 -> 1784403357 00002000:00010000:2.0:1784403357.652820:0:7099:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784403356 00002000:00010000:2.0:1784403357.652822:0:7099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1784403357 -> 1784403357 00002000:00010000:2.0:1784403357.652824:0:7099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784403357.653220:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240926848:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 684us (1602us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784403357.653231:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:1.0:1784403357.672264:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403357.672474:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240927104 00000100:00100000:2.0:1784403357.672512:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240927104 00000100:00100000:2.0:1784403357.672597:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:2.0:1784403357.672611:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:10546:x1871082240927104:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784403357.672710:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.672731:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec6a expref: 15 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.672741:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.672788:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec6a expref: 15 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.672803:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec6a expref: 15 pid: 6292 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403357.672819:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260862208:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403357.673096:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45253900 going to sleep for 11 seconds 00000100:00100000:3.0:1784403357.681174:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403357.681360:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260862208:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403357.681393:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.683790:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240927232 00000100:00100000:0.0:1784403357.683810:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240927232 00010000:00010000:2.0:1784403357.688296:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec6a expref: 16 pid: 6292 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403357.688444:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:2.0:1784403357.688481:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:2360:x1871082240927232:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403357.688505:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403357.688514:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec6a expref: 16 pid: 6292 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.688529:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec6a expref: 16 pid: 6292 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.688558:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afaf48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec6a expref: 16 pid: 6292 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.688581:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884d000) 00010000:00010000:2.0:1784403357.688601:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.688614:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.688624:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.688668:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403357.688750:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:2360:x1871082240927232:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 274us (7590us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403357.688759:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00010000:00010000:1.0:1784403357.688841:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.688860:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.688916:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.688925:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.688933:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.688940:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403357.688945:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.688953:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.688977:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884d000) 00010000:00010000:1.0:1784403357.688981:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784403357.688985:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.688992:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afaf8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403357.689046:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:10546:x1871082240927104:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 Request processed in 16438us (18890us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784403357.689057:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:2.0:1784403357.703804:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.704802:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240927360 00000100:00100000:0.0:1784403357.704823:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240927360 00000100:00100000:0.0:1784403357.704950:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:0.0:1784403357.705121:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2358:x1871082240927360:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784403357.705418:0:8571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.705451:0:8571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 7 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.705485:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784403357.705490:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403357.705507:0:8571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.706253:0:8571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 7 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.707155:0:8571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 7 pid: 7101 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.707183:0:8571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73694e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8571:1871082260862336:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403357.707459:0:8571:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410af780 going to sleep for 11 seconds 00000100:00100000:1.0:1784403357.717621:0:8571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73694e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8571:1871082260862336:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403357.717663:0:8571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403357.733754:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.734096:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240927488 00000100:00100000:0.0:1784403357.734110:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240927488 00010000:00010000:0.0:1784403357.734169:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 8 pid: 7101 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.734219:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:0.0:1784403357.734231:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240927488:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403357.734253:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403357.734295:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 8 pid: 7101 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.734334:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 8 pid: 7101 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.734374:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd3d5a4/0x6828175665afaf72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec86 expref: 8 pid: 7101 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.734396:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403357.734401:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403357.734409:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.734420:0:6278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.734459:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403357.734549:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240927488:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 319us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.734558:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 56 00010000:00010000:1.0:1784403357.734915:0:8571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.734928:0:8571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.734977:0:8571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.734988:0:8571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.734998:0:8571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.735006:0:8571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403357.735011:0:8571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.735022:0:8571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.735054:0:8571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.735062:0:8571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afaf95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403357.735127:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240927360:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 Request processed in 30166us (31339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403357.735138:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:0.0:1784403357.746191:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403357.746292:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240927744 00000100:00100000:2.0:1784403357.746304:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240927744 00000100:00100000:2.0:1784403357.746400:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 127 00000100:00100000:2.0:1784403357.746414:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:10546:x1871082240927744:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784403357.747005:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afaf9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.747030:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afaf9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.747278:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afaf9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.747716:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.747732:0:6293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec71 expref: 15 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.747741:0:6293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.747789:0:6293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec71 expref: 15 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.747809:0:6293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec71 expref: 15 pid: 6292 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403357.747826:0:6293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73642d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260862464:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403357.747973:0:6293:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac180 going to sleep for 11 seconds 00000100:00100000:3.0:1784403357.756153:0:6293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73642d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260862464:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403357.756198:0:6293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.759066:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403357.759307:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240927872 00000100:00100000:2.0:1784403357.759320:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240927872 00010000:00010000:2.0:1784403357.759408:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec71 expref: 16 pid: 6292 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403357.759471:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:2.0:1784403357.759483:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:2360:x1871082240927872:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403357.759504:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403357.759513:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec71 expref: 16 pid: 6292 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.759528:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec71 expref: 16 pid: 6292 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.759662:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afaf56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec71 expref: 16 pid: 6292 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.759683:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884d000) 00010000:00010000:2.0:1784403357.759689:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.759701:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.759709:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.759740:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784403357.759775:0:6293:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.759785:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403357.759814:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:2360:x1871082240927872:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 333us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403357.759821:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00000001:00080000:2.0:1784403357.763018:0:6293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1784403357.763744:0:6293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1784403357.763812:0:6293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1784403357.763991:0:6293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73640380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6293:1871082260862592:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784403357.764189:0:6293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403357.764333:0:6293:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a736ac180 going to sleep for 11 seconds 00000100:00100000:3.0:1784403357.764551:0:6298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260862592 00000100:00100000:3.0:1784403357.764787:0:6298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260862592 00000100:00100000:2.0:1784403357.765204:0:6298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784403357.765217:0:6298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6293:x1871082260862592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784403357.765393:0:6298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6293:x1871082260862592:12345-0@lo:1000:mdt00_001.0 Request processed in 177us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403357.765402:0:6298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784403357.765502:0:6293:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1784403357.765510:0:6293:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1784403357.765538:0:6293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a73695c00, transno 4294967309 00000100:00100000:3.0:1784403357.765572:0:6293:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8c8a73695880 x1871082260861696/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784403373 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403357.765587:0:6293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73640380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6293:1871082260862592:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1784403357.766243:0:6293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1784403357.766363:0:6293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6293:1871082260862720:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784403357.766432:0:6293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403357.769842:0:6293:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a75ff5240 going to sleep for 11 seconds 00000100:00100000:0.0:1784403357.769914:0:6297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260862720 00000100:00100000:0.0:1784403357.769926:0:6297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260862720 00000100:00100000:1.0:1784403357.770255:0:6297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784403357.770277:0:6297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6293:x1871082260862720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784403357.772498:0:6297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6293:x1871082260862720:12345-0@lo:1000:mdt00_001.0 Request processed in 2219us (6052us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784403357.772516:0:6297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784403357.772674:0:6293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6293:1871082260862720:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1784403357.772730:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772742:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772750:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772757:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403357.772763:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772772:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772816:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884d000) 00010000:00010000:3.0:1784403357.772819:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403357.772825:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772833:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afafa3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772904:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772912:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772919:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772923:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403357.772926:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772932:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772940:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:3.0:1784403357.772943:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403357.772952:0:6293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaeed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec55 expref: 18 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772966:0:6293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaeed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec55 expref: 18 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.772984:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaeed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec55 expref: 18 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.773028:0:6293:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaeed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec55 expref: 18 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403357.773056:0:6293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260862848:192.168.204.28@tcp:105: 00000100:00100000:3.0:1784403357.773152:0:6293:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a75ff5240 going to sleep for 11 seconds 00000100:00100000:3.0:1784403357.778338:0:6293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260862848:192.168.204.28@tcp:105: 00010000:00010000:3.0:1784403357.778392:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778405:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0200/0x6828175665afaee6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778452:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafaa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778471:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778494:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778510:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778517:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafaa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778891:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafaa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778898:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403357.778910:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafaa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778919:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafaa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778933:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:3.0:1784403357.778936:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403357.778939:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafaa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.778945:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafaa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.779025:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afaf9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.779033:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afaf9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.779038:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afaf9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.779044:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403357.779107:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afaf9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.779128:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afaf9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.779138:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:3.0:1784403357.779140:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784403357.779144:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afaf9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.779150:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afaf9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784403357.779937:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403357.779944:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784403357.780452:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1784403357.780463:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784403357.781493:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:10546:x1871082240927744:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 35067us (35302us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1784403357.781511:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 127 00000020:00080000:3.0:1784403357.781521:0:6293:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1784403357.787417:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.787522:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403357.790936:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240928000 00000100:00100000:3.0:1784403357.790964:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240928000 00000100:00100000:0.0:1784403357.791162:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240928256 00000100:00100000:0.0:1784403357.791168:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240928256 00000100:00100000:0.0:1784403357.791241:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:0.0:1784403357.791254:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:10546:x1871082240928256:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784403357.792686:0:6295:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784403357.792822:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1784403357.793153:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.793174:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.793187:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.793197:0:6295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.793203:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.793210:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.793235:0:6295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784403357.793716:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:10546:x1871082240928256:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 2457us (6186us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1784403357.793728:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00000020:00080000:0.0:1784403357.793735:0:6295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784403357.793736:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403357.793745:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.793753:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403357.793758:0:6280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.793766:0:6280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.793775:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:0.0:1784403357.793785:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:10545:x1871082240928000:12345-192.168.204.28@tcp:49:lfs.0 00010000:00010000:1.0:1784403357.793790:0:6280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c8a4884db00) 00010000:00010000:1.0:1784403357.793792:0:6280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784403357.793798:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.793803:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403357.793821:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403357.793823:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403357.793824:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403357.793919:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:10545:x1871082240928000:12345-192.168.204.28@tcp:49:lfs.0 Request processed in 135us (6655us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.793926:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:2.0:1784403357.800200:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.800548:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240928512 00000100:00100000:0.0:1784403357.800562:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240928512 00000100:00100000:0.0:1784403357.800641:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 128 00000100:00100000:0.0:1784403357.800655:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:10545:x1871082240928512:12345-192.168.204.28@tcp:58:lfs.0 00000040:00080000:0.0:1784403357.801112:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1784403357.801230:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:10545:x1871082240928512:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 577us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.801239:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 128 00000100:00100000:2.0:1784403357.858695:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403357.858777:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240928640 00000100:00100000:0.0:1784403357.858792:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240928640 00000100:00100000:0.0:1784403357.858918:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 129 00000100:00100000:0.0:1784403357.858929:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:10548:x1871082240928640:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403357.858968:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403357.858996:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec8d expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859088:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afafbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859106:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afafbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859119:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afafbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859156:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afafc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859164:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afafc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859172:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afafc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859578:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859591:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec4e expref: 21 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859600:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859642:0:6294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec4e expref: 21 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.859658:0:6294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec4e expref: 21 pid: 10011 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403357.859676:0:6294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af43480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260862976:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403357.859804:0:6294:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410afe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784403357.862685:0:6294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af43480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260862976:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403357.862731:0:6294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403357.863256:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403357.863339:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240928896 00000100:00100000:1.0:1784403357.863349:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240928896 00000100:00100000:1.0:1784403357.863421:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:1.0:1784403357.863433:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+22:5574:x1871082240928896:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784403357.863778:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:5574:x1871082240928896:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 346us (521us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1784403357.863787:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:2.0:1784403357.867726:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403357.868262:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240929024 00000100:00100000:3.0:1784403357.868283:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240929024 00010000:00010000:3.0:1784403357.868339:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec4e expref: 23 pid: 10011 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403357.868379:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:3.0:1784403357.868389:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:2361:x1871082240929024:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403357.868409:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403357.868417:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec4e expref: 23 pid: 10011 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.868464:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec4e expref: 23 pid: 10011 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.868837:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afaed8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec4e expref: 23 pid: 10011 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.868859:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:3.0:1784403357.869037:0:6277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.869117:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403357.869126:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403357.873804:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403357.873953:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+22:2361:x1871082240929024:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 5552us (6229us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403357.873969:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 58 00010000:00010000:0.0:1784403357.881145:0:6294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.881169:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403357.881239:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784403357.881244:0:6294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403357.882320:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882352:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882364:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afafbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882372:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afafbf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882381:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afafbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882388:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403357.882392:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afafbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882400:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afafbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882418:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403357.882455:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403357.882461:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afafbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882467:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afafbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882493:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afafc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882499:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afafc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882506:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afafc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882511:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403357.882514:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afafc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882519:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afafc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882526:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c8a4884d800) 00010000:00010000:0.0:1784403357.882528:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403357.882531:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afafc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882536:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afafc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882593:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afafb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec8d expref: 22 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882624:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec8d expref: 21 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403357.882633:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:0.0:1784403357.882635:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403357.882638:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5800, rc 0) 00000100:00100000:0.0:1784403357.882743:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:10548:x1871082240928640:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 23814us (24065us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403357.882753:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 129 00000100:00100000:0.0:1784403357.921623:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260863104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403357.921734:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403357.922111:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260863104 00000100:00100000:2.0:1784403357.922121:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260863104 00000100:00100000:2.0:1784403357.922185:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784403357.922197:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260863104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403357.922228:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1784403357.923434:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260863104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1229us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403357.923449:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784403357.929234:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260863104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784403358.562822:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784403358.805536:0:12472:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784403358.805545:0:12472:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784403358.805589:0:12472:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784403358.805596:0:12472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1784403358.816273:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403358.816284:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784403358.816339:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784403358.816346:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784403358.816487:0:12049:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af42a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260863232:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784403358.816848:0:12049:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410afd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784403358.829933:0:12049:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af42a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260863232:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784403358.846521:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403358.846957:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240929152 00000100:00100000:3.0:1784403358.846970:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240929152 00000100:00100000:3.0:1784403358.847088:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 130 00000100:00100000:3.0:1784403358.847101:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:10559:x1871082240929152:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784403358.847141:0:10011:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784403358.847265:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:10559:x1871082240929152:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 167us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403358.847288:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 130 00000100:00080000:1.0:1784403358.852973:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784403358.858319:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403358.858423:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240929408 00000100:00100000:3.0:1784403358.858437:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240929408 00000100:00100000:3.0:1784403358.858510:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 131 00000100:00100000:3.0:1784403358.858521:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:10559:x1871082240929408:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403358.858549:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403358.858574:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafd4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec94 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403358.858960:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afafdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403358.858977:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afafdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403358.858990:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afafdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403358.859004:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784403358.859294:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afafd4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec94 expref: 24 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403358.859316:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afafdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec94 expref: 23 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403358.859325:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:3.0:1784403358.859328:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403358.859333:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403358.859410:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:10559:x1871082240929408:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 890us (1104us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1784403358.859418:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 131 00000100:00100000:0.0:1784403358.867971:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403358.872661:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403358.872899:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240929664 00000100:00100000:1.0:1784403358.872910:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240929664 00000100:00100000:2.0:1784403358.873314:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 132 00000100:00100000:2.0:1784403358.873327:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:10559:x1871082240929664:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784403358.873420:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afafe9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403358.873440:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afafe9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403358.873452:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afafe9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403358.873695:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afafe9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403358.873704:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afafe9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403358.873712:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afafe9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403358.873719:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403358.873723:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afafe9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403358.873731:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afafe9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403358.873743:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:2.0:1784403358.873747:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784403358.873767:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afafe9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403358.873773:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afafe9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403358.874330:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:10559:x1871082240929664:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 1000us (6365us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1784403358.874340:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 132 00000040:00080000:1.0:1784403358.874543:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784403358.874548:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1784403358.874977:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240929792 00000100:00100000:3.0:1784403358.874986:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240929792 00000100:00100000:3.0:1784403358.875069:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:3.0:1784403358.875080:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:2359:x1871082240929792:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403358.875097:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403358.875121:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afafdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec94 expref: 24 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403358.875139:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:3.0:1784403358.875144:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403358.875178:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:2359:x1871082240929792:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 100us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403358.875185:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000040:00080000:1.0:1784403358.875943:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784403358.875967:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784403358.886790:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403358.887112:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240930048 00000100:00100000:0.0:1784403358.887124:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240930048 00000100:00100000:0.0:1784403358.887195:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:0.0:1784403358.887205:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:10559:x1871082240930048:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784403358.887487:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:10559:x1871082240930048:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 282us (707us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1784403358.887507:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00010000:00010000:0.0:1784403359.585703:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403359.968133:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260863488:0@lo:400:kworker.0 00000100:00100000:0.0:1784403359.968250:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403359.968329:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260864000:0@lo:400:kworker.0 00000100:00100000:0.0:1784403359.968365:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403359.968406:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784403359.968413:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260863616:0@lo:400:kworker.0 00000100:00100000:0.0:1784403359.968463:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403359.968504:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260863488 00000100:00100000:0.0:1784403359.968514:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260863488 00000100:00100000:0.0:1784403359.968577:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260863616 00000100:00100000:0.0:1784403359.968580:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260863616 00000100:00100000:0.0:1784403359.968616:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784403359.968626:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260863488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403359.968701:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260863488:12345-0@lo:400:kworker.0 Request processed in 74us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403359.968713:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784403359.968736:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784403359.968742:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260863616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403359.968772:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260863616:12345-0@lo:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403359.968778:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784403359.968799:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260864000 00000100:00100000:0.0:1784403359.968803:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260864000 00000100:00100000:0.0:1784403359.968832:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784403359.968846:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3565:x1871082260864000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403359.968913:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3565:x1871082260864000:12345-0@lo:400:kworker.0 Request processed in 68us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403359.968919:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1784403359.968939:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784403359.968945:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403359.968981:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260863616:0@lo:400:kworker.0 00000100:00100000:0.0:1784403359.968992:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260863488:0@lo:400:kworker.0 00000100:00100000:0.0:1784403359.969002:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260864000:0@lo:400:kworker.0 00000100:00100000:2.0:1784403359.969111:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260863360:0@lo:400:kworker.0 00000100:00100000:2.0:1784403359.969152:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403359.969187:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260863872:0@lo:400:kworker.0 00000100:00100000:2.0:1784403359.969210:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403359.969241:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784403359.969248:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260863744:0@lo:400:kworker.0 00000100:00100000:2.0:1784403359.969272:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403359.969306:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260863872 00000100:00100000:2.0:1784403359.969309:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260863872 00000100:00100000:2.0:1784403359.969339:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784403359.969345:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260863872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403359.969380:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260863872:12345-0@lo:400:kworker.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403359.969386:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784403359.969412:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260863872:0@lo:400:kworker.0 00000100:00100000:2.0:1784403359.969448:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260863744 00000100:00100000:2.0:1784403359.969451:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260863744 00000100:00100000:2.0:1784403359.969477:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784403359.969484:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3568:x1871082260863744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403359.969528:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3568:x1871082260863744:12345-0@lo:400:kworker.0 Request processed in 44us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403359.969535:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784403359.969563:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260863744:0@lo:400:kworker.0 00000100:00100000:0.0:1784403359.969815:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260863360 00000100:00100000:0.0:1784403359.969820:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260863360 00000100:00100000:0.0:1784403359.969921:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1784403359.969930:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260863360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403359.969970:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260863360:12345-0@lo:400:kworker.0 Request processed in 41us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403359.969977:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:3.0:1784403359.972675:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784403359.972693:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403359.972784:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260863360:0@lo:400:kworker.0 00000100:00100000:0.0:1784403360.489699:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260864128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784403360.489768:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403360.489893:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260864128 00000100:00100000:2.0:1784403360.489901:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260864128 00000100:00100000:2.0:1784403360.489954:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784403360.489962:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3566:x1871082260864128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403360.489996:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403360.490043:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3566:x1871082260864128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403360.490051:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784403360.490093:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260864128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784403360.607011:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784403360.715654:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403360.715665:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784403360.715713:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784403360.715719:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784403360.920420:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403360.920504:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240930304 00000100:00100000:2.0:1784403360.920513:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240930304 00000100:00100000:2.0:1784403360.920631:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:2.0:1784403360.920641:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:10581:x1871082240930304:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403360.920666:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403360.920688:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afaff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ec9b expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403360.920818:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afaff7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403360.920836:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afaff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403360.920879:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afaff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403360.920893:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1784403360.921041:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afaff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec9b expref: 27 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403360.921060:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afaff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec9b expref: 26 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403360.921069:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:2.0:1784403360.921072:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784403360.921075:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2200, rc 0) 00000100:00100000:2.0:1784403360.921136:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:10581:x1871082240930304:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 495us (725us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1784403360.921143:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00080000:1.0:1784403360.921661:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403360.927513:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403360.927565:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240930432 00000100:00100000:0.0:1784403360.927576:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240930432 00000100:00100000:0.0:1784403360.927639:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 134 00000100:00100000:0.0:1784403360.927660:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:10581:x1871082240930432:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:0.0:1784403360.927735:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afb005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403360.927767:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afb005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403360.927780:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afb005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403360.927810:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afb005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403360.927817:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afb005 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403360.927824:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afb005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403360.927831:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403360.927836:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afb005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403360.927844:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afb005 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403360.927857:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:0.0:1784403360.927861:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784403360.927889:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afb005 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403360.927896:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4400/0x6828175665afb005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403360.927964:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:10581:x1871082240930432:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 308us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403360.927971:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 134 00000100:00100000:2.0:1784403361.041434:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403361.041514:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240930560 00000100:00100000:0.0:1784403361.041537:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240930560 00000100:00100000:0.0:1784403361.041610:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:0.0:1784403361.041621:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240930560:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:0.0:1784403361.041640:0:7099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403361.041663:0:7099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f86c24e4/0x6828175665afb00c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eca2 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784403361.041691:0:7099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a5bd59d, atime: 0x6a5bd59c, ctime: 0x6a5bd59d, blocks: 0xb 00010000:00010000:0.0:1784403361.041711:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1784403361.041715:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403361.041725:0:7099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f86c24e4/0x6828175665afb00c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca2 expref: 7 pid: 7099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403361.041746:0:7099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f86c24e4/0x6828175665afb00c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca2 expref: 7 pid: 7099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403361.041760:0:7099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4400, rc 0) 00000100:00100000:0.0:1784403361.041818:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240930560:12345-192.168.204.28@tcp:101:cat.0 Request processed in 198us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403361.041826:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00080000:2.0:1784403361.043183:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403361.048753:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403361.048887:0:7107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240930688 00000100:00100000:2.0:1784403361.048898:0:7107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240930688 00002000:00100000:2.0:1784403361.048945:0:7107:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8c8a77e1a680 x1871082240930688/t0(0) o3->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:132/0 lens 488/0 e 0 to 0 dl 1784403372 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784403361.048957:0:7107:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a77e1a680 with x1871082240930688 ext(0->4095) 00002000:00010000:2.0:1784403361.048963:0:7107:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a77e1a680 00000100:00100000:2.0:1784403361.049004:0:7107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:2.0:1784403361.049013:0:7107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240930688:12345-192.168.204.28@tcp:3:cat.0 00000100:00100000:2.0:1784403361.049255:0:7107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240930688:12345-192.168.204.28@tcp:3:cat.0 Request processed in 241us (512us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784403361.049264:0:7107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00002000:00100000:2.0:1784403361.049270:0:7107:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8c8a77e1a680 x1871082240930688/t0(0) o3->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:132/0 lens 488/4536 e 0 to 0 dl 1784403372 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784403361.049279:0:7107:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a77e1a680 with x1871082240930688 ext(0->4095) 00002000:00010000:2.0:1784403361.049282:0:7107:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a77e1a680 00000001:00080000:1.0:1784403361.069620:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1784403361.069644:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:0.0:1784403361.637412:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403362.364429:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403362.364485:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403362.364528:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403362.364543:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240931200 00000100:00100000:1.0:1784403362.364554:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240931200 00000100:00100000:0.0:1784403362.364559:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403362.364586:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403362.364613:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240931072 00000100:00100000:0.0:1784403362.364618:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240931072 00000100:00100000:1.0:1784403362.364633:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:1.0:1784403362.364646:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240931200:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403362.364657:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:0.0:1784403362.364667:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240931072:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403362.364723:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240931200:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403362.364731:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:1.0:1784403362.364764:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240930816 00000100:00100000:1.0:1784403362.364768:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240930816 00000100:00100000:3.0:1784403362.364791:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240930944 00000100:00100000:3.0:1784403362.364799:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240930944 00000100:00100000:1.0:1784403362.364803:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 293 00000100:00100000:1.0:1784403362.364814:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240930816:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403362.364842:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240931328 00000100:00100000:3.0:1784403362.364846:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240931328 00000100:00100000:3.0:1784403362.364898:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 143 00000100:00100000:3.0:1784403362.364907:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:2360:x1871082240930944:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403362.365147:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 144 00000100:00100000:2.0:1784403362.365157:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240931328:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403362.366073:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240931072:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 1402us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403362.366084:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00080000:0.0:1784403362.366149:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784403362.366156:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784403362.366753:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240930816:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 1938us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403362.366764:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 293 00000100:00100000:3.0:1784403362.369626:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:2360:x1871082240930944:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 4706us (5193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403362.369626:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240931328:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 4457us (5024us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403362.369648:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 144 00000100:00100000:3.0:1784403362.369661:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 143 00000001:00080000:1.0:1784403362.608316:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1784403362.608340:0:6314:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1784403362.608375:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1784403362.608413:0:6314:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c8a75ff5600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1784403362.608418:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a44fafe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a75ff59c0 00000020:00080000:1.0:1784403362.608422:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a44faff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a77e81c00 00000020:00080000:0.0:1784403362.609592:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1784403362.609804:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1784403362.655305:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403363.041933:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260864256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784403363.042022:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403363.042211:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260864256 00000100:00100000:2.0:1784403363.042220:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260864256 00000100:00100000:2.0:1784403363.042291:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784403363.042301:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260864256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403363.042335:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403363.042381:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260864256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403363.042388:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1784403363.042707:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403363.042748:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260864256:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1784403363.102398:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1784403363.102415:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1784403363.102421:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:1.0:1784403363.680633:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403364.703469:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784403365.025287:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784403365.025298:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784403365.025729:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1784403365.025736:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784403365.088799:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260864768:0@lo:400:kworker.0 00000100:00100000:0.0:1784403365.088908:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403365.089006:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260864384:0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.089057:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403365.089103:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260864896:0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.089138:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403365.089185:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260864640:0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.089212:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403365.089229:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784403365.089235:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260864512:0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.089253:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403365.089267:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260865024:0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.089293:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260864384 00000100:00100000:2.0:1784403365.089299:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260864384 00000100:00100000:2.0:1784403365.089359:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1784403365.089368:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260864384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.089416:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260864384:12345-0@lo:400:kworker.0 Request processed in 49us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403365.089424:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1784403365.089455:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260864896 00000100:00100000:2.0:1784403365.089458:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260864896 00000100:00100000:2.0:1784403365.089487:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260864640 00000100:00100000:2.0:1784403365.089489:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260864640 00000100:00100000:2.0:1784403365.089501:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260864512 00000100:00100000:2.0:1784403365.089502:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260864512 00000100:00100000:2.0:1784403365.089513:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784403365.089518:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260864896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.089546:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260864896:12345-0@lo:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403365.089552:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784403365.089563:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784403365.089569:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260864640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.089598:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260864640:12345-0@lo:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403365.089611:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784403365.089623:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784403365.089629:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260864512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.089658:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260864512:12345-0@lo:400:kworker.0 Request processed in 30us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403365.089663:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1784403365.089686:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403365.089722:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260864384:0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.089734:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260864896:0@lo:400:kworker.0 00000100:00100000:0.0:1784403365.090167:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260864768 00000100:00100000:0.0:1784403365.090173:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260864768 00000100:00100000:0.0:1784403365.090207:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784403365.090213:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260864768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403365.090249:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260864768:12345-0@lo:400:kworker.0 Request processed in 36us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403365.090263:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784403365.090291:0:3567:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1784403365.090297:0:3567:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a73695880, transno 4294967310 00000004:00080000:0.0:1784403365.090307:0:3567:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1784403365.091414:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260864768:0@lo:400:kworker.0 00000100:00080000:2.0:1784403365.092236:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403365.092261:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403365.092349:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260864640:0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.092375:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260864512:0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.092404:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260865024 00000100:00100000:2.0:1784403365.092410:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260865024 00000100:00100000:2.0:1784403365.092459:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784403365.092468:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260865024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403365.092528:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260865024:12345-0@lo:400:kworker.0 Request processed in 61us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403365.092535:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1784403365.092560:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784403365.092574:0:3566:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1784403365.092580:0:3566:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1784403365.092597:0:3566:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a73697100, transno 4294967304 00000100:00100000:2.0:1784403365.092619:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260865024:0@lo:400:kworker.0 00000100:00100000:0.0:1784403365.600191:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784403365.600217:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b625880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260865152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784403365.600288:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403365.600398:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260865152 00000100:00100000:2.0:1784403365.600406:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260865152 00000100:00100000:2.0:1784403365.601054:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784403365.601066:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260865152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403365.601103:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403365.601164:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260865152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403365.601171:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784403365.602898:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b625880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260865152:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784403365.729197:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403366.043763:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403366.043915:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240931456 00000100:00100000:2.0:1784403366.043925:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240931456 00000100:00100000:2.0:1784403366.044000:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 135 00000100:00100000:2.0:1784403366.044013:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:10226:x1871082240931456:12345-192.168.204.28@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784403366.044137:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:10226:x1871082240931456:12345-192.168.204.28@tcp:60:lhsmtool_posix.0 Request processed in 126us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403366.044146:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 135 00000100:00080000:0.0:1784403366.044218:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403366.050962:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403366.051006:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240931712 00000100:00100000:1.0:1784403366.051016:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240931712 00000100:00100000:1.0:1784403366.051074:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:1.0:1784403366.051086:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:10226:x1871082240931712:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784403366.053077:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:10226:x1871082240931712:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 1983us (2207us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1784403366.053090:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:1.0:1784403366.289907:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403366.290098:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240931840 00000100:00100000:2.0:1784403366.290119:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240931840 00000100:00100000:2.0:1784403366.290208:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 136 00000100:00100000:2.0:1784403366.290219:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:11035:x1871082240931840:12345-192.168.204.28@tcp:101:lsof.0 00010000:00010000:2.0:1784403366.290239:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403366.290273:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb013 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eca9 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403366.290334:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403366.290353:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403366.290366:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403366.290552:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784403366.290557:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403366.290641:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403366.290664:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb013 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca9 expref: 7 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403366.290681:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca9 expref: 6 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403366.290689:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:2.0:1784403366.290692:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784403366.290695:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3200, rc 0) 00000100:00100000:2.0:1784403366.290760:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:11035:x1871082240931840:12345-192.168.204.28@tcp:101:lsof.0 Request processed in 543us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403366.290767:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 136 00000100:00080000:0.0:1784403366.291758:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784403366.753074:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403367.488725:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403367.488775:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403367.488823:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403367.488857:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403367.488907:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403367.488943:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240932352 00000100:00100000:0.0:1784403367.488952:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240932352 00000100:00100000:0.0:1784403367.489008:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240932224 00000100:00100000:0.0:1784403367.489011:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240932224 00000100:00100000:0.0:1784403367.489033:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:0.0:1784403367.489042:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2361:x1871082240932352:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403367.489132:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2361:x1871082240932352:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 89us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403367.489140:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:2.0:1784403367.489230:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240932096 00000100:00100000:2.0:1784403367.489235:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240932096 00000100:00100000:2.0:1784403367.489266:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240932480 00000100:00100000:2.0:1784403367.489269:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240932480 00000100:00100000:2.0:1784403367.489290:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 148 00000100:00100000:2.0:1784403367.489297:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2361:x1871082240932096:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403367.489336:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2361:x1871082240932096:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 40us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403367.489343:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 148 00000100:00100000:2.0:1784403367.489369:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 149 00000100:00100000:2.0:1784403367.489376:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2361:x1871082240932480:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403367.489396:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2361:x1871082240932480:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 20us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403367.489401:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 149 00000100:00100000:3.0:1784403367.489519:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240931968 00000100:00100000:3.0:1784403367.489524:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240931968 00000100:00100000:3.0:1784403367.489557:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 295 00000100:00100000:3.0:1784403367.489564:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2361:x1871082240931968:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403367.489591:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2361:x1871082240931968:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 28us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403367.489597:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 295 00000100:00100000:1.0:1784403367.494030:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:1.0:1784403367.494072:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240932224:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403367.494196:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240932224:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 147us (5336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403367.494205:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00080000:1.0:1784403367.494471:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784403367.494479:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1784403367.688252:0:6314:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1784403367.688283:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1784403367.688328:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1784403367.688351:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1784403367.775360:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403368.163652:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260865280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403368.163734:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403368.165373:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260865280 00000100:00100000:2.0:1784403368.165386:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260865280 00000100:00100000:2.0:1784403368.165466:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784403368.165477:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7cfc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260865280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403368.165533:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403368.165612:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7cfc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260865280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403368.165619:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784403368.165853:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260865280:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784403368.165928:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784403368.802944:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403369.823981:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784403369.967671:0:12727:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:36:08 (1784403368) 00000100:00100000:0.0:1784403370.207076:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260865408:0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.207149:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403370.207198:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260865920:0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.207226:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403370.207254:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784403370.207260:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260865792:0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.207286:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403370.207316:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260865536:0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.207360:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403370.207379:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260866048:0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.207401:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403370.207418:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784403370.207423:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260865664:0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.207443:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403370.207488:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260865408 00000100:00100000:0.0:1784403370.207496:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260865408 00000100:00100000:1.0:1784403370.207528:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260865792 00000100:00100000:1.0:1784403370.207533:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260865792 00000100:00100000:0.0:1784403370.207541:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1784403370.207549:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260865408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403370.207569:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260866048 00000100:00100000:1.0:1784403370.207571:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260866048 00000100:00100000:1.0:1784403370.207592:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784403370.207596:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260865408:12345-0@lo:400:kworker.0 Request processed in 48us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403370.207603:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1784403370.207606:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260865792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.207636:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260865920 00000100:00100000:0.0:1784403370.207639:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260865920 00000100:00100000:1.0:1784403370.207640:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260865792:12345-0@lo:400:kworker.0 Request processed in 35us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403370.207646:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784403370.207658:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784403370.207664:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260866048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.207670:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260865536 00000100:00100000:0.0:1784403370.207672:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260865536 00000100:00100000:0.0:1784403370.207690:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260865664 00000100:00100000:0.0:1784403370.207693:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260865664 00000100:00100000:1.0:1784403370.207694:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260866048:12345-0@lo:400:kworker.0 Request processed in 31us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403370.207700:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784403370.207712:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784403370.207717:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784403370.207718:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260865920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403370.207722:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260865536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403370.207747:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260865536:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403370.207747:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260865920:12345-0@lo:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403370.207753:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784403370.207974:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784403370.207988:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784403370.207995:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260865664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.208027:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260865664:12345-0@lo:400:kworker.0 Request processed in 34us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403370.208044:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784403370.208103:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260865792:0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.208115:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260865408:0@lo:400:kworker.0 00000100:00100000:0.0:1784403370.208132:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260865920:0@lo:400:kworker.0 00000100:00080000:1.0:1784403370.208246:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784403370.208252:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784403370.208254:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403370.208283:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260865664:0@lo:400:kworker.0 00000100:00100000:1.0:1784403370.208293:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260865536:0@lo:400:kworker.0 00000100:00100000:1.0:1784403370.208301:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260866048:0@lo:400:kworker.0 00000100:00100000:1.0:1784403370.719301:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784403370.719326:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260866176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403370.719413:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403370.719655:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260866176 00000100:00100000:2.0:1784403370.719663:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260866176 00000100:00100000:2.0:1784403370.719725:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784403370.719754:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260866176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403370.719793:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403370.719852:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260866176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403370.719860:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784403370.719979:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260866176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784403370.847306:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403371.508181:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403371.508254:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240932736 00000100:00100000:0.0:1784403371.508265:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240932736 00000100:00100000:0.0:1784403371.508351:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 137 00000100:00100000:0.0:1784403371.508362:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:11300:x1871082240932736:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784403371.508384:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403371.508406:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb021 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ecb0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.508508:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb028 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.508524:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb028 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.508538:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb028 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.508555:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb02f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.508563:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb02f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.508571:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb02f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509190:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb036 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509203:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509211:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403371.509222:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1784403371.509436:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb028 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509444:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb028 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509457:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb028 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509464:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403371.509468:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb028 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509475:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb028 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509488:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c8a51bd0200) 00010000:00010000:0.0:1784403371.509491:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403371.509496:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb028 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509503:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb028 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509516:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb02f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509522:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb02f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509527:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb02f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509532:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403371.509535:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb02f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509550:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb02f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509558:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c8a4884d400) 00010000:00010000:0.0:1784403371.509560:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403371.509562:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb02f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.509568:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb02f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.510022:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb021 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecb0 expref: 16 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.510042:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb036 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecb0 expref: 15 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403371.510049:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:0.0:1784403371.510052:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403371.510054:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4200, rc 0) 00000100:00100000:0.0:1784403371.510127:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:11300:x1871082240932736:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 1767us (1956us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1784403371.510136:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 137 00000100:00080000:1.0:1784403371.510435:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784403371.517092:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403371.517169:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403371.517330:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240932864 00000100:00100000:2.0:1784403371.517340:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240932864 00000100:00100000:3.0:1784403371.517372:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240932992 00000100:00100000:3.0:1784403371.517377:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240932992 00000100:00100000:2.0:1784403371.517400:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 138 00000100:00100000:2.0:1784403371.517410:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:11300:x1871082240932864:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784403371.517413:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1784403371.517419:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+16:2360:x1871082240932992:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403371.517435:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403371.517460:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb036 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecb0 expref: 16 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403371.517493:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:3.0:1784403371.517498:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403371.517504:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:11300:x1871082240932864:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 Request processed in 96us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403371.517512:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 138 00000100:00100000:3.0:1784403371.517515:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:2360:x1871082240932992:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 97us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403371.517522:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00010000:00010000:2.0:1784403371.883623:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784403372.191140:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784403372.191149:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784403372.191629:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1784403372.191638:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784403372.609711:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403372.609746:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403372.609773:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403372.609793:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403372.609816:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403372.609857:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240933376 00000100:00100000:0.0:1784403372.609883:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240933376 00000100:00100000:0.0:1784403372.609944:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240933504 00000100:00100000:0.0:1784403372.609947:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240933504 00000100:00100000:0.0:1784403372.609974:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00100000:0.0:1784403372.609985:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240933376:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403372.610080:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240933376:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 96us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403372.610088:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00100000:0.0:1784403372.610104:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:0.0:1784403372.610111:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240933504:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403372.610135:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240933504:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403372.610141:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:0.0:1784403372.610162:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240933632 00000100:00100000:0.0:1784403372.610165:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240933632 00000100:00100000:0.0:1784403372.610194:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240933248 00000100:00100000:0.0:1784403372.610197:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240933248 00000100:00100000:0.0:1784403372.610215:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 153 00000100:00100000:0.0:1784403372.610221:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2358:x1871082240933632:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403372.610248:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2358:x1871082240933632:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 27us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403372.610255:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 153 00000100:00100000:0.0:1784403372.610266:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 154 00000100:00100000:0.0:1784403372.610272:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2358:x1871082240933248:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403372.610298:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2358:x1871082240933248:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403372.610310:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 154 00000100:00080000:0.0:1784403372.610332:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784403372.610337:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784403372.610339:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403372.614468:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240933120 00000100:00100000:3.0:1784403372.614488:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240933120 00000100:00100000:3.0:1784403372.614560:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 297 00000100:00100000:3.0:1784403372.614573:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2358:x1871082240933120:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403372.614668:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2358:x1871082240933120:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 97us (4966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403372.614678:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 297 00000001:00080000:1.0:1784403372.821984:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:1.0:1784403372.895102:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403373.285350:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260866304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403373.285430:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403373.285512:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260866304 00000100:00100000:0.0:1784403373.285520:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260866304 00000100:00100000:0.0:1784403373.285576:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784403373.285586:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b33b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260866304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784403373.285623:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784403373.285669:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b33b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260866304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403373.285677:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1784403373.285700:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403373.285741:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260866304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403373.753479:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403373.757157:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240933760 00000100:00100000:0.0:1784403373.757172:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240933760 00000100:00100000:0.0:1784403373.757244:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 139 00000100:00100000:0.0:1784403373.757257:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:11342:x1871082240933760:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403373.757277:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403373.757300:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb044 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ecb7 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757373:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb04b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757401:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb04b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757415:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb04b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757431:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb052 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757438:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb052 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757445:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb052 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757706:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb04b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757715:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb04b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757722:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb04b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757729:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403373.757734:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb04b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757742:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb04b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757755:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:0.0:1784403373.757763:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403373.757769:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb04b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757775:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb04b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757787:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb052 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757793:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb052 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757799:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb052 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757805:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403373.757808:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb052 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757815:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb052 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757822:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c8a4884de00) 00010000:00010000:0.0:1784403373.757825:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403373.757829:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb052 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757834:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb052 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757886:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb044 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecb7 expref: 14 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757908:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:0.0:1784403373.757911:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403373.757914:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb044 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecb7 expref: 14 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.757924:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4c00, rc 0) 00000100:00100000:0.0:1784403373.758005:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:11342:x1871082240933760:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 751us (4533us total) trans 0 rc 301/301 00000100:00100000:0.0:1784403373.758013:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 139 00000100:00080000:0.0:1784403373.758057:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403373.787577:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403373.787733:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240934016 00000100:00100000:0.0:1784403373.787744:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240934016 00000100:00100000:0.0:1784403373.787815:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 140 00000100:00100000:0.0:1784403373.787826:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:11342:x1871082240934016:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1784403373.787911:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403373.787948:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414ff400/0x6828175665afa9c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaf0 expref: 13 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.787987:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:0.0:1784403373.787993:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403373.788412:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.788429:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca9 expref: 5 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.788452:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.788490:0:6294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca9 expref: 5 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.788506:0:6294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca9 expref: 5 pid: 10011 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403373.788522:0:6294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260866432:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403373.788629:0:6294:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc25480 going to sleep for 11 seconds 00000100:00100000:0.0:1784403373.797542:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403373.798222:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240934144 00000100:00100000:1.0:1784403373.798234:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240934144 00010000:00010000:1.0:1784403373.798289:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca9 expref: 6 pid: 10011 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403373.798338:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:1.0:1784403373.798349:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2360:x1871082240934144:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403373.798367:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403373.798374:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca9 expref: 6 pid: 10011 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403373.798388:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca9 expref: 6 pid: 10011 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403373.798414:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:1.0:1784403373.798421:0:6277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403373.798431:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403373.798454:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403373.798477:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403373.798534:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2360:x1871082240934144:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 186us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403373.798543:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 59 00010000:00010000:2.0:1784403373.803541:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb01a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca9 expref: 5 pid: 10011 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403373.803567:0:6294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260866432:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403373.803592:0:6294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.803603:0:6294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.803609:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.803647:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.803659:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.803668:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403373.806569:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1784403373.806592:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.806603:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.806611:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.806618:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403373.806623:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.806632:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.806652:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a51bd0300) 00010000:00010000:2.0:1784403373.806655:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403373.806660:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.806678:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb059 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403373.806700:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046df8f08 reply state 00000000364211d5 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403373.806709:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784403373.806830:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:11342:x1871082240934016:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 19000us (19258us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1784403373.806841:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 140 00010000:00010000:2.0:1784403373.813377:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.813395:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.813403:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.813409:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403373.813413:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.813421:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.813437:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c8a429d0400) 00010000:00010000:2.0:1784403373.813440:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403373.813445:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.813461:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb060 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403373.928363:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403373.964553:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403373.964676:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240934272 00000100:00100000:0.0:1784403373.964686:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240934272 00000100:00100000:0.0:1784403373.964754:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 141 00000100:00100000:0.0:1784403373.964766:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:11350:x1871082240934272:12345-192.168.204.28@tcp:101:lctl.0 00010000:00010000:0.0:1784403373.964793:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403373.964817:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ecbe expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.964935:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afb06e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.964949:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afb06e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.964962:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afb06e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403373.965060:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784403373.965064:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403373.965248:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afb06e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.965276:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecbe expref: 15 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.965292:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afb06e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecbe expref: 14 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403373.965301:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:0.0:1784403373.965304:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403373.965308:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4600, rc 0) 00000100:00100000:0.0:1784403373.965373:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:11350:x1871082240934272:12345-192.168.204.28@tcp:101:lctl.0 Request processed in 609us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403373.965381:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 141 00000100:00100000:1.0:1784403374.020015:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403374.021038:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240934400 00000100:00100000:2.0:1784403374.021062:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240934400 00000100:00100000:3.0:1784403374.021372:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 142 00000100:00100000:3.0:1784403374.021389:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:11356:x1871082240934400:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403374.021413:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403374.021435:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ecc5 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.021648:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb07c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.021665:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb07c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.021677:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb07c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.021714:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb083 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.021723:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.021731:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023182:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afb08a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023198:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afb08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023208:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afb08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403374.023243:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1784403374.023247:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403374.023270:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afb08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023283:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb07c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023290:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb07c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023297:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb07c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023317:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403374.023321:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb07c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023328:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb07c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023339:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:3.0:1784403374.023342:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403374.023346:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb07c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023350:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb07c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023364:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023369:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb083 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023373:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb083 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023377:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403374.023380:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb083 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023384:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb083 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023399:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c8a43245400) 00010000:00010000:3.0:1784403374.023401:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403374.023403:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb083 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023409:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb083 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023444:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecc5 expref: 16 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023457:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afb08a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecc5 expref: 15 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.023463:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403374.023465:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784403374.023467:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6400, rc 0) 00000100:00100000:3.0:1784403374.023550:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:11356:x1871082240934400:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2165us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403374.023559:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 142 00000100:00100000:2.0:1784403374.027332:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.027502:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240934656 00000100:00100000:0.0:1784403374.027512:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240934656 00000100:00100000:0.0:1784403374.027578:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 143 00000100:00100000:0.0:1784403374.027590:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+15:11356:x1871082240934656:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403374.027612:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403374.027634:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb091 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eccc expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.027789:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb098 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.027826:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.027837:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.027955:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.027972:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.027979:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784403374.028706:0:6292:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1784403374.028911:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.028924:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.028932:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.028977:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.028985:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb098 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.028992:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb098 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.029005:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403374.029010:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb098 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.029017:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb098 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.029028:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:0.0:1784403374.029031:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403374.029035:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb098 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.029040:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb098 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784403374.029052:0:6292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000890867f9 reply state 00000000913a87bb transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403374.029061:0:6292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784403374.029097:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb091 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eccc expref: 18 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.029112:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eccc expref: 17 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.029398:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884d400) 00010000:00010000:0.0:1784403374.029403:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403374.029405:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4000, rc 0) 00000100:00100000:0.0:1784403374.029487:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:11356:x1871082240934656:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1898us (2164us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1784403374.029503:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 143 00010000:00010000:2.0:1784403374.034732:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.034752:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.034760:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.034766:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403374.034770:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.034779:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.034796:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a4884d700) 00010000:00010000:2.0:1784403374.034799:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403374.034804:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.034811:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb09f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403374.039586:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.039683:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240934784 00000100:00100000:0.0:1784403374.039693:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240934784 00000100:00100000:0.0:1784403374.039768:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:0.0:1784403374.039779:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240934784:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403374.039797:0:7101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403374.039819:0:7101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf92650a/0x6828175665afb0b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ecd3 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784403374.039846:0:7101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784403374.039900:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1784403374.039905:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403374.039915:0:7101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf92650a/0x6828175665afb0b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecd3 expref: 6 pid: 7101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.039935:0:7101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf92650a/0x6828175665afb0b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecd3 expref: 6 pid: 7101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.039949:0:7101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5a00, rc 0) 00000100:00100000:0.0:1784403374.040024:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240934784:12345-192.168.204.28@tcp:101:bash.0 Request processed in 245us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403374.040031:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00080000:2.0:1784403374.040395:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784403374.043984:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.044249:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240934912 00000100:00100000:0.0:1784403374.044260:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240934912 00000100:00100000:0.0:1784403374.044321:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:0.0:1784403374.044332:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:11356:x1871082240934912:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403374.044365:0:7099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403374.044389:0:7099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ecda expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.044424:0:7099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf92650a/0x6828175665afb0b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecd3 expref: 7 pid: 7101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.044434:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403374.044438:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403374.044443:0:7099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 7 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.044481:0:7099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf92650a/0x6828175665afb0b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecd3 expref: 7 pid: 7101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.044494:0:7099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf92650a/0x6828175665afb0b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecd3 expref: 7 pid: 7101 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403374.044509:0:7099:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7099:1871082260866560:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403374.044607:0:7099:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc25c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784403374.049325:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403374.049443:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240935040 00000100:00100000:1.0:1784403374.049453:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240935040 00010000:00010000:1.0:1784403374.049509:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf92650a/0x6828175665afb0b4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecd3 expref: 8 pid: 7101 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403374.049557:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:1.0:1784403374.049567:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240935040:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403374.049581:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403374.049605:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf92650a/0x6828175665afb0b4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecd3 expref: 8 pid: 7101 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.049618:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf92650a/0x6828175665afb0b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecd3 expref: 8 pid: 7101 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.049645:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403374.049650:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403374.049672:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 8 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.049683:0:6278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 8 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.049724:0:6278:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 8 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403374.049738:0:6278:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e17100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6278:1871082260866688:192.168.204.28@tcp:105: 00000100:00100000:1.0:1784403374.049833:0:6278:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1784403374.050950:0:7099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf92650a/0x6828175665afb0b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecd3 expref: 8 pid: 7101 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403374.050987:0:7099:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7099:1871082260866560:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403374.051017:0:7099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 7 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.051045:0:7099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5600, rc 0) 00000100:00100000:0.0:1784403374.051108:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:11356:x1871082240934912:12345-192.168.204.28@tcp:101:bash.0 Request processed in 6777us (7142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403374.051118:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:1.0:1784403374.067013:0:6278:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e17100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6278:1871082260866688:192.168.204.28@tcp:105: 00010000:00010000:1.0:1784403374.067047:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403374.067118:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2360:x1871082240935040:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 17550us (17800us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403374.067133:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403374.067133:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:0.0:1784403374.067227:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240935296 00000100:00100000:0.0:1784403374.067237:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240935296 00000100:00100000:0.0:1784403374.067289:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:0.0:1784403374.067298:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:11356:x1871082240935296:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1784403374.067618:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:11356:x1871082240935296:12345-192.168.204.28@tcp:35:bash.0 Request processed in 319us (503us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1784403374.067626:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:2.0:1784403374.139715:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.139912:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240935552 00000100:00100000:0.0:1784403374.139923:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240935552 00000100:00100000:0.0:1784403374.139994:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 144 00000100:00100000:0.0:1784403374.140005:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:11366:x1871082240935552:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403374.140030:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403374.140053:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb0c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ece1 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403374.140191:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1784403374.140310:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb0c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ece1 expref: 20 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.140325:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:0.0:1784403374.140340:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784403374.140345:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb0c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ece1 expref: 20 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.140357:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5a00, rc 0) 00000100:00100000:0.0:1784403374.140422:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:11366:x1871082240935552:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 419us (718us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1784403374.140430:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 144 00000100:00100000:3.0:1784403374.143926:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.144080:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240935808 00000100:00100000:0.0:1784403374.144091:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240935808 00000100:00100000:0.0:1784403374.144162:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:0.0:1784403374.144173:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:11366:x1871082240935808:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1784403374.144469:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:11366:x1871082240935808:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 297us (553us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1784403374.144477:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:1.0:1784403374.240517:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403374.240761:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240935936 00000100:00100000:2.0:1784403374.240773:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240935936 00000100:00100000:2.0:1784403374.240841:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 145 00000100:00100000:2.0:1784403374.240853:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:11372:x1871082240935936:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403374.240906:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403374.240942:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb0d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ece8 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.241022:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb0d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.241038:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.241050:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403374.241110:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1784403374.241114:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403374.241137:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.241164:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb0d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ece8 expref: 22 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.241214:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ece8 expref: 21 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.241223:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:2.0:1784403374.241226:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784403374.241229:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2a00, rc 0) 00000100:00100000:2.0:1784403374.241290:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:11372:x1871082240935936:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 440us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403374.241297:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 145 00000100:00100000:1.0:1784403374.247831:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.247950:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240936192 00000100:00100000:0.0:1784403374.247970:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240936192 00000100:00100000:0.0:1784403374.248036:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 146 00000100:00100000:0.0:1784403374.248047:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:11372:x1871082240936192:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403374.248070:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403374.248094:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb0de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ecef expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.248193:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb0e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.248206:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.248231:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403374.248243:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784403374.248373:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb0de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecef expref: 24 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.248393:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecef expref: 23 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.248402:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884d400) 00010000:00010000:0.0:1784403374.248405:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403374.248409:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4800, rc 0) 00000100:00100000:0.0:1784403374.248476:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:11372:x1871082240936192:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 431us (656us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1784403374.248483:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 146 00000100:00100000:3.0:1784403374.252483:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403374.252532:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403374.252624:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240936448 00000100:00100000:2.0:1784403374.252637:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240936448 00000100:00100000:2.0:1784403374.252706:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 147 00000100:00100000:2.0:1784403374.252715:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:11372:x1871082240936448:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403374.252739:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403374.252770:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb0f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ecf6 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.252907:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb0fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.252923:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb0fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.252935:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb0fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403374.252946:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784403374.253102:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb0f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecf6 expref: 26 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.253120:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb0fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecf6 expref: 25 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.253129:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884d400) 00010000:00010000:2.0:1784403374.253132:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784403374.253135:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3e00, rc 0) 00000100:00100000:2.0:1784403374.253200:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+25:11372:x1871082240936448:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 486us (742us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1784403374.253207:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 147 00000100:00100000:0.0:1784403374.253780:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240936576 00000100:00100000:0.0:1784403374.253787:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240936576 00000100:00100000:0.0:1784403374.253837:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1784403374.253845:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+25:2361:x1871082240936576:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403374.253856:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403374.253905:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb0e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecef expref: 25 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.253918:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884d400) 00010000:00010000:0.0:1784403374.253921:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403374.253957:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:2361:x1871082240936576:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 113us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403374.253977:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:3.0:1784403374.265201:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.265278:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240936704 00000100:00100000:0.0:1784403374.265288:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240936704 00000100:00100000:0.0:1784403374.265347:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:0.0:1784403374.265358:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240936704:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:0.0:1784403374.265407:0:7101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.265430:0:7101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 6 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.265441:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403374.265446:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403374.265451:0:7101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.265488:0:7101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 6 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.265501:0:7101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 6 pid: 7099 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403374.265517:0:7101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7101:1871082260866816:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403374.265613:0:7101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc25b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784403374.268363:0:7101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7101:1871082260866816:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403374.268409:0:7101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403374.269955:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403374.270184:0:7107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240936832 00000100:00100000:2.0:1784403374.270195:0:7107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240936832 00002000:00100000:2.0:1784403374.270248:0:7107:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8c8a737f9f80 x1871082240936832/t0(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:145/0 lens 504/0 e 0 to 0 dl 1784403385 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784403374.270259:0:7107:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a737f9f80 with x1871082240936832 ext(0->12) 00010000:00010000:2.0:1784403374.270270:0:7107:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 7 pid: 7099 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.270288:0:7107:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 7 pid: 7099 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784403374.270298:0:7107:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c8a737f9f80 00000100:00100000:2.0:1784403374.270327:0:7107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:2.0:1784403374.270337:0:7107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240936832:12345-192.168.204.28@tcp:4:lfs.0 00000100:00100000:2.0:1784403374.271012:0:7107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2361:x1871082240936832:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 672us (1063us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784403374.271027:0:7107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00002000:00100000:2.0:1784403374.271035:0:7107:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8c8a737f9f80 x1871082240936832/t4294967305(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:145/0 lens 504/448 e 0 to 0 dl 1784403385 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784403374.271044:0:7107:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a737f9f80 with x1871082240936832 ext(0->12) 00010000:00010000:2.0:1784403374.271050:0:7107:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 9 pid: 7099 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.271063:0:7107:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 9 pid: 7099 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784403374.271070:0:7107:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c8a737f9f80 00000100:00100000:1.0:1784403374.274569:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.274687:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240936960 00000100:00100000:0.0:1784403374.274697:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240936960 00010000:00010000:0.0:1784403374.274800:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 9 pid: 7099 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403374.274910:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:0.0:1784403374.274921:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2360:x1871082240936960:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403374.274937:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784403374.274957:0:6278:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784403374.274972:0:6278:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784403374 00002000:00010000:0.0:1784403374.274975:0:6278:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784403374 00002000:00010000:0.0:1784403374.274978:0:6278:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1784403374 00010000:00010000:0.0:1784403374.274984:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 9 pid: 7099 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.275000:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 9 pid: 7099 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.275025:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdd3d5a4/0x6828175665afb0bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecda expref: 9 pid: 7099 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.275042:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403374.275047:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403374.275069:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.275081:0:6278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.275109:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403374.275247:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240936960:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 259us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403374.275256:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00010000:00010000:1.0:1784403374.276305:0:7101:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.276322:0:7101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.276354:0:7101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.276373:0:7101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.276381:0:7101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.276388:0:7101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403374.276393:0:7101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.276402:0:7101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.276419:0:7101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.276428:0:7101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004d88abb/0x6828175665afb108 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403374.276532:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240936704:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 11173us (11349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403374.276543:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:1.0:1784403374.278929:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403374.279026:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240937216 00000100:00100000:2.0:1784403374.279037:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240937216 00000100:00100000:2.0:1784403374.279093:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:2.0:1784403374.279103:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497ae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:11372:x1871082240937216:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:2.0:1784403374.279164:0:6295:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb0fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecf6 expref: 24 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784403374.279426:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1784403374.279466:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1784403374.280064:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1784403374.280125:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.280142:0:6295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eccc expref: 28 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.280164:0:6295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.280200:0:6295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eccc expref: 28 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.280216:0:6295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eccc expref: 28 pid: 6292 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403374.280233:0:6295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b59500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6295:1871082260866944:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403374.280320:0:6295:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4571bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784403374.283353:0:6295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b59500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6295:1871082260866944:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403374.283386:0:6295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403374.284278:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403374.284521:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240937344 00000100:00100000:2.0:1784403374.284531:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240937344 00010000:00010000:2.0:1784403374.284571:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eccc expref: 29 pid: 6292 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403374.284613:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:2.0:1784403374.284623:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:2360:x1871082240937344:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403374.284639:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403374.284646:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eccc expref: 29 pid: 6292 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.284661:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eccc expref: 29 pid: 6292 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.284685:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb0a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eccc expref: 29 pid: 6292 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.284714:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884d400) 00010000:00010000:2.0:1784403374.284719:0:6277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.284729:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.284747:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.284778:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403374.284822:0:6295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.284831:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403374.284834:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:2360:x1871082240937344:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 211us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403374.284849:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 62 00000001:00080000:0.0:1784403374.285010:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1784403374.285287:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1784403374.285400:0:6295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e19500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260867072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784403374.285447:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403374.285482:0:6295:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403374.285509:0:6297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260867072 00000100:00100000:1.0:1784403374.285521:0:6297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260867072 00000100:00100000:1.0:1784403374.285573:0:6297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784403374.285581:0:6297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6295:x1871082260867072:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784403374.285655:0:6297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6295:x1871082260867072:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403374.285662:0:6297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1784403374.285970:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784403374.286348:0:6295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e19500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260867072:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784403374.286918:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1784403374.286996:0:6295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e15880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260867200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784403374.287045:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403374.287074:0:6295:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403374.287088:0:6297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260867200 00000100:00100000:0.0:1784403374.287096:0:6297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260867200 00000100:00100000:0.0:1784403374.287151:0:6297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784403374.287160:0:6297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6295:x1871082260867200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784403374.287360:0:6297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6295:x1871082260867200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 200us (314us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784403374.287368:0:6297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784403374.287418:0:6295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e15880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260867200:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784403374.287462:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1784403374.287507:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.287518:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.287525:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.287531:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403374.287535:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.287544:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.287560:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884d400) 00010000:00010000:1.0:1784403374.287563:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784403374.287573:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.287580:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb10f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784403374.288033:0:6295:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784403374.288149:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1784403374.288161:0:6295:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379856293918ns, next at 380856291602ns, rc = 0 00000001:00080000:1.0:1784403374.288168:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1784403374.288210:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884d400) 00010000:00010000:1.0:1784403374.288214:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784403374.288221:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb0fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecf6 expref: 32 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403374.288365:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497ae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:11372:x1871082240937216:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 9263us (9443us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1784403374.288373:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00000020:00080000:1.0:1784403374.288377:0:6295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784403374.292382:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.292672:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240937472 00000100:00100000:0.0:1784403374.292683:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240937472 00000100:00100000:0.0:1784403374.292737:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 148 00000100:00100000:0.0:1784403374.292746:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:11372:x1871082240937472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403374.292771:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403374.292794:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb116 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ecfd expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.292855:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb116 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecfd expref: 32 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.292887:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb116 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecfd expref: 32 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.292908:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:0.0:1784403374.292911:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784403374.292915:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5600, rc 0) 00000100:00100000:1.0:1784403374.293180:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+32:11372:x1871082240937472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 434us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403374.293383:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 148 00000100:00100000:2.0:1784403374.296526:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403374.296670:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240937728 00000100:00100000:3.0:1784403374.296693:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240937728 00000100:00100000:3.0:1784403374.296799:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:3.0:1784403374.296811:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+32:11372:x1871082240937728:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1784403374.297097:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+33:11372:x1871082240937728:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 288us (579us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1784403374.297116:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:2.0:1784403374.382135:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.382236:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240937984 00000100:00100000:0.0:1784403374.382248:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240937984 00000100:00100000:0.0:1784403374.382328:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 149 00000100:00100000:0.0:1784403374.382353:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+33:11382:x1871082240937984:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403374.382383:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403374.382420:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb11d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed04 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403374.382552:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1784403374.382694:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb11d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed04 expref: 35 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.382709:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:0.0:1784403374.382712:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784403374.382718:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb11d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed04 expref: 35 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.382735:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5a00, rc 0) 00000100:00100000:0.0:1784403374.382814:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:11382:x1871082240937984:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 465us (689us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1784403374.382821:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 149 00000100:00100000:2.0:1784403374.385833:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403374.385921:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240938112 00000100:00100000:3.0:1784403374.385931:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240938112 00000100:00100000:3.0:1784403374.386004:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 150 00000100:00100000:3.0:1784403374.386016:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:11382:x1871082240938112:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:3.0:1784403374.386128:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb12b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386147:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb12b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386159:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb12b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386174:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb132 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386182:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386189:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386307:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386334:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386342:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784403374.386383:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386396:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb12b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386403:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb12b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386410:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb12b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386417:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403374.386422:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb12b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386428:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb12b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386439:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403374.386443:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403374.386447:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb12b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386453:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb12b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386478:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386484:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb132 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386490:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386495:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403374.386498:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386504:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb132 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386512:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a43245400) 00010000:00010000:3.0:1784403374.386514:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403374.386517:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb132 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386522:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb132 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386535:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386541:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386546:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386558:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403374.386562:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386566:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386589:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:3.0:1784403374.386591:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403374.386595:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.386601:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403374.386671:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:11382:x1871082240938112:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 657us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403374.386680:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 150 00000100:00100000:2.0:1784403374.389677:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403374.389829:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240938368 00000100:00100000:1.0:1784403374.389839:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240938368 00000100:00100000:1.0:1784403374.389915:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:1.0:1784403374.389925:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:11382:x1871082240938368:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403374.390411:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+35:11382:x1871082240938368:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 485us (743us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1784403374.390437:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:2.0:1784403374.458814:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403374.459950:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240938624 00000100:00100000:3.0:1784403374.459971:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240938624 00000100:00100000:3.0:1784403374.460098:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 151 00000100:00100000:3.0:1784403374.460109:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+35:11385:x1871082240938624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403374.460135:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403374.460159:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb140 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed0b expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460240:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb147 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460274:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb147 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460287:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb147 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460302:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb14e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460309:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460315:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460455:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460464:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460471:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403374.460482:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784403374.460576:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb147 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460584:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb147 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460666:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb147 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460679:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403374.460890:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb147 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460901:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb147 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460913:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403374.460915:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403374.460920:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb147 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460926:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb147 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460941:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460946:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb14e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460952:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb14e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460970:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403374.460973:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb14e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460980:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb14e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.460998:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a43245400) 00010000:00010000:3.0:1784403374.461000:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403374.461003:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb14e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.461009:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb14e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.461121:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb140 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed0b expref: 38 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.461136:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed0b expref: 37 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.461144:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:3.0:1784403374.461146:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403374.461148:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6600, rc 0) 00000100:00100000:3.0:1784403374.461272:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+37:11385:x1871082240938624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1163us (2469us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1784403374.461279:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 151 00000100:00100000:2.0:1784403374.464249:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403374.464337:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240938752 00000100:00100000:3.0:1784403374.464346:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240938752 00000100:00100000:3.0:1784403374.464408:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 152 00000100:00100000:3.0:1784403374.464419:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+37:11385:x1871082240938752:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:3.0:1784403374.464484:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.464501:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.464526:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.464555:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.464562:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.464569:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.464575:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403374.464581:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.466196:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.466221:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:3.0:1784403374.466224:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403374.466229:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.466236:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403374.466338:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+37:11385:x1871082240938752:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 1916us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403374.466346:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 152 00000100:00100000:2.0:1784403374.469624:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403374.469701:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240939008 00000100:00100000:3.0:1784403374.469712:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240939008 00000100:00100000:3.0:1784403374.469780:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:3.0:1784403374.469791:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+37:11385:x1871082240939008:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1784403374.470113:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+38:11385:x1871082240939008:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 324us (499us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1784403374.470122:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:2.0:1784403374.736088:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.736190:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240939264 00000100:00100000:0.0:1784403374.736201:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240939264 00000100:00100000:0.0:1784403374.736263:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 153 00000100:00100000:0.0:1784403374.736273:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+38:11416:x1871082240939264:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:0.0:1784403374.736296:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403374.736318:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb16a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed12 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.736415:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.736430:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.736456:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403374.736467:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784403374.736600:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb16a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed12 expref: 41 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.736621:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed12 expref: 40 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.736629:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:0.0:1784403374.736632:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403374.736635:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4000, rc 0) 00000100:00100000:0.0:1784403374.736700:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:11416:x1871082240939264:12345-192.168.204.28@tcp:101:cat.0 Request processed in 428us (621us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1784403374.736707:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 153 00000100:00100000:2.0:1784403374.746439:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403374.746909:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240939520 00000100:00100000:1.0:1784403374.746920:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240939520 00000100:00100000:1.0:1784403374.746993:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:1.0:1784403374.747004:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:11416:x1871082240939520:12345-192.168.204.28@tcp:35:cat.0 00000100:00100000:1.0:1784403374.748689:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+41:11416:x1871082240939520:12345-192.168.204.28@tcp:35:cat.0 Request processed in 1677us (2251us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1784403374.748803:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:2.0:1784403374.748923:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403374.754385:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240939648 00000100:00100000:0.0:1784403374.754401:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240939648 00000100:00100000:0.0:1784403374.754497:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:0.0:1784403374.754507:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+41:2360:x1871082240939648:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403374.754524:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403374.754550:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb171 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed12 expref: 41 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403374.754572:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:0.0:1784403374.754578:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403374.754669:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:2360:x1871082240939648:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 164us (5747us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403374.754678:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:3.0:1784403374.827555:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403374.827824:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240939904 00000100:00100000:1.0:1784403374.827834:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240939904 00000100:00100000:1.0:1784403374.827913:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 154 00000100:00100000:1.0:1784403374.827923:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:11422:x1871082240939904:12345-192.168.204.28@tcp:101:dd.0 00010000:00010000:1.0:1784403374.827957:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403374.827960:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784403374.827987:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb0d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ece8 expref: 40 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.828007:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:1.0:1784403374.828011:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784403374.828025:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afb17f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed19 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.828137:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.828151:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed0b expref: 40 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.828181:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.828219:0:6294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed0b expref: 40 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.828232:0:6294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed0b expref: 40 pid: 6292 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403374.828245:0:6294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260867328:192.168.204.28@tcp:104: 00000100:00100000:1.0:1784403374.828347:0:6294:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1000 going to sleep for 11 seconds 00000100:00100000:2.0:1784403374.833710:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403374.833711:0:6294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260867328:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403374.833743:0:6294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403374.833994:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240940032 00000100:00100000:3.0:1784403374.834001:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240940032 00010000:00010000:3.0:1784403374.834029:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed0b expref: 41 pid: 6292 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403374.834249:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:3.0:1784403374.834260:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+41:2360:x1871082240940032:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403374.834276:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403374.834284:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed0b expref: 41 pid: 6292 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.834297:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed0b expref: 41 pid: 6292 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.834321:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed0b expref: 41 pid: 6292 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.834340:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:3.0:1784403374.834345:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.834371:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.834379:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.834410:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403374.834470:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:2360:x1871082240940032:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 212us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403374.834478:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 63 00010000:00010000:1.0:1784403374.834632:0:6294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.834641:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403374.834660:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784403374.834816:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afb17f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed19 expref: 41 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.834833:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed19 expref: 40 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403374.834853:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:1.0:1784403374.834856:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784403374.834859:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1000, rc 0) 00000100:00100000:1.0:1784403374.834918:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:11422:x1871082240939904:12345-192.168.204.28@tcp:101:dd.0 Request processed in 6996us (7372us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1784403374.834925:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 154 00000100:00100000:0.0:1784403374.841852:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403374.842472:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240940288 00000100:00100000:2.0:1784403374.842483:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240940288 00000100:00100000:2.0:1784403374.842565:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 155 00000100:00100000:2.0:1784403374.842599:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:11422:x1871082240940288:12345-192.168.204.28@tcp:36:dd.0 00010000:00010000:2.0:1784403374.844477:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.844508:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.844523:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784403374.844633:0:6293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1784403374.844878:0:6293:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d83a994 reply state 000000008ef247a7 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403374.844889:0:6293:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784403374.845727:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+43:11422:x1871082240940288:12345-192.168.204.28@tcp:36:dd.0 Request processed in 3146us (3880us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1784403374.846038:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 155 00000020:00080000:2.0:1784403374.846047:0:6293:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784403374.859853:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.859983:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.859992:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.859998:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403374.860003:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.860010:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.860028:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:3.0:1784403374.860032:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403374.860037:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403374.860192:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb194 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403374.943702:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403375.112431:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403375.112570:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240940416 00000100:00100000:3.0:1784403375.112590:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240940416 00000100:00100000:3.0:1784403375.112683:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 156 00000100:00100000:3.0:1784403375.112695:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+42:11436:x1871082240940416:12345-192.168.204.28@tcp:101:stat.0 00000100:00080000:2.0:1784403375.113167:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784403375.113216:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403375.113245:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb19b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed20 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113322:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb1a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113339:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb1a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113352:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb1a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113369:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb1a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113376:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113382:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113496:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113524:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed19 expref: 43 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113533:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113571:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed19 expref: 43 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.113600:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed19 expref: 43 pid: 6294 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403375.113613:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260867456:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403375.113768:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7ae0aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784403375.129187:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403375.130759:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240940672 00000100:00100000:0.0:1784403375.130773:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240940672 00000100:00100000:0.0:1784403375.131136:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:0.0:1784403375.131147:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+44:5573:x1871082240940672:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784403375.131509:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+45:5573:x1871082240940672:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 362us (2331us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1784403375.131518:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:3.0:1784403375.139479:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260867456:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403375.139512:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403375.140608:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403375.140971:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240940800 00000100:00100000:3.0:1784403375.140981:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240940800 00010000:00010000:3.0:1784403375.141024:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed19 expref: 45 pid: 6294 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403375.141073:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:3.0:1784403375.141083:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+45:2360:x1871082240940800:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403375.141100:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403375.141119:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed19 expref: 45 pid: 6294 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.141133:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed19 expref: 45 pid: 6294 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.141158:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb186 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed19 expref: 45 pid: 6294 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.141175:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:3.0:1784403375.141181:0:6277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.141192:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.141199:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.141234:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403375.141294:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+44:2360:x1871082240940800:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 212us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403375.141303:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 64 00010000:00010000:1.0:1784403375.141515:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141524:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403375.141589:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1784403375.141594:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403375.141616:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141629:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141639:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb1a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141646:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb1a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141652:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb1a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141658:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403375.141669:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb1a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141687:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb1a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141697:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:1.0:1784403375.141700:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403375.141704:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb1a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141709:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb1a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141720:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141725:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb1a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141744:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb1a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141748:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403375.141751:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb1a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141756:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb1a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141762:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a43245400) 00010000:00010000:1.0:1784403375.141764:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403375.141773:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb1a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.141779:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb1a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.142108:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb19b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed20 expref: 44 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.142124:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed20 expref: 43 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.142132:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:1.0:1784403375.142134:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403375.142137:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:1.0:1784403375.142187:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+43:11436:x1871082240940416:12345-192.168.204.28@tcp:101:stat.0 Request processed in 29494us (29766us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403375.142194:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 156 00000100:00100000:2.0:1784403375.212385:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403375.212479:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240941056 00000100:00100000:3.0:1784403375.212491:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240941056 00000100:00100000:3.0:1784403375.212558:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 157 00000100:00100000:3.0:1784403375.212569:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+43:11442:x1871082240941056:12345-192.168.204.28@tcp:36:truncate.0 00010000:00010000:3.0:1784403375.212635:0:6292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403375.212667:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed20 expref: 43 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.212706:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:3.0:1784403375.212713:0:6292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403375.232959:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.232985:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.232998:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784403375.233483:0:6292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1784403375.233545:0:6292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009247ba80 reply state 00000000a74f57bb transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403375.233556:0:6292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784403375.233698:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+45:11442:x1871082240941056:12345-192.168.204.28@tcp:36:truncate.0 Request processed in 21126us (21318us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1784403375.233709:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 157 00000020:00080000:0.0:1784403375.233732:0:6292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784403375.241303:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.241321:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.241328:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.241333:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403375.241337:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.241364:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.241382:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:1.0:1784403375.241385:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403375.241390:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.241396:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb1b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784403375.264361:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403375.264375:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784403375.264585:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1784403375.264593:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784403375.331560:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260867712:0@lo:400:kworker.0 00000100:00100000:2.0:1784403375.331648:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403375.331664:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260867968:0@lo:400:kworker.0 00000100:00100000:1.0:1784403375.331708:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403375.331782:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784403375.331790:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260867584:0@lo:400:kworker.0 00000100:00100000:0.0:1784403375.331817:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260867840:0@lo:400:kworker.0 00000100:00100000:1.0:1784403375.331826:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403375.331858:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260868096:0@lo:400:kworker.0 00000100:00100000:0.0:1784403375.331896:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403375.331932:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260867584 00000100:00100000:1.0:1784403375.331950:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260867584 00000100:00100000:1.0:1784403375.332002:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1784403375.332011:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260867584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403375.332063:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3567:x1871082260867584:12345-0@lo:400:kworker.0 Request processed in 53us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403375.332071:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1784403375.332109:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260867968 00000100:00100000:1.0:1784403375.332113:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260867968 00000100:00100000:1.0:1784403375.332167:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784403375.332204:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260867968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403375.332240:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260867968:12345-0@lo:400:kworker.0 Request processed in 38us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403375.332246:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784403375.335388:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260868224:0@lo:400:kworker.0 00000100:00100000:2.0:1784403375.336289:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784403375.336393:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403375.336585:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260868224 00000100:00100000:1.0:1784403375.336595:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260868224 00000100:00100000:1.0:1784403375.336661:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784403375.336672:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260868224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403375.337403:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260868224:12345-0@lo:400:kworker.0 Request processed in 733us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403375.337436:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784403375.337926:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260868224:0@lo:400:kworker.0 00000100:00100000:3.0:1784403375.340446:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260867712 00000100:00100000:3.0:1784403375.340484:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260867712 00000100:00100000:3.0:1784403375.340545:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260867840 00000100:00100000:3.0:1784403375.340549:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260867840 00000100:00100000:3.0:1784403375.340605:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784403375.340617:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260867712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403375.340717:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260867712:12345-0@lo:400:kworker.0 Request processed in 102us (9069us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403375.340725:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784403375.340742:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784403375.340748:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260867840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403375.340781:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260867840:12345-0@lo:400:kworker.0 Request processed in 33us (8920us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403375.340787:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1784403375.341544:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403375.342291:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260867712:0@lo:400:kworker.0 00000100:00100000:1.0:1784403375.345302:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403375.345353:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260867968:0@lo:400:kworker.0 00000100:00100000:0.0:1784403375.345353:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260867840:0@lo:400:kworker.0 00000100:00100000:1.0:1784403375.345381:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260867584:0@lo:400:kworker.0 00000100:00100000:3.0:1784403375.345688:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260868096 00000100:00100000:3.0:1784403375.345696:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260868096 00000100:00100000:3.0:1784403375.345777:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784403375.345788:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260868096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403375.345895:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260868096:12345-0@lo:400:kworker.0 Request processed in 108us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403375.345902:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784403375.345909:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260868096:0@lo:400:kworker.0 00000100:00080000:2.0:1784403375.345977:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403375.451090:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403375.451598:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240941184 00000100:00100000:1.0:1784403375.451610:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240941184 00000100:00100000:1.0:1784403375.451678:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 158 00000100:00100000:1.0:1784403375.451688:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+44:11456:x1871082240941184:12345-192.168.204.28@tcp:101:stat.0 00010000:00010000:1.0:1784403375.451714:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403375.451851:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afb1be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed27 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452047:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb1c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452082:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452097:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452114:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452122:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452129:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452337:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452348:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452427:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403375.452469:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1784403375.452478:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403375.452552:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452565:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452584:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452591:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb1c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452598:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452604:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403375.452609:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452699:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb1c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452713:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:1.0:1784403375.452716:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403375.452720:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb1c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452732:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb1c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452745:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.452752:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.453526:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.453540:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403375.453544:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.453551:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.453562:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a51bd0700) 00010000:00010000:1.0:1784403375.453565:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403375.453568:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.453574:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.453619:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afb1be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed27 expref: 46 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.453634:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed27 expref: 45 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.453641:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:1.0:1784403375.453643:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403375.453646:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1800, rc 0) 00000100:00100000:1.0:1784403375.453731:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+45:11456:x1871082240941184:12345-192.168.204.28@tcp:101:stat.0 Request processed in 2043us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403375.453741:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 158 00000100:00100000:0.0:1784403375.548323:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403375.548447:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240941440 00000100:00100000:3.0:1784403375.548462:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240941440 00000100:00100000:3.0:1784403375.548686:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 159 00000100:00100000:3.0:1784403375.548999:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+45:11466:x1871082240941440:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403375.549030:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403375.549060:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed2e expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403375.549227:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784403375.551127:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed2e expref: 47 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.551156:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:3.0:1784403375.551161:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403375.551167:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb1da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed2e expref: 47 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.551188:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403375.551301:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+46:11466:x1871082240941440:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2308us (2994us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1784403375.551313:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 159 00000100:00100000:2.0:1784403375.558340:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403375.558535:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240941696 00000100:00100000:3.0:1784403375.558549:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240941696 00000100:00100000:3.0:1784403375.558646:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:3.0:1784403375.558659:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+46:11466:x1871082240941696:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1784403375.559125:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:11466:x1871082240941696:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 466us (797us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1784403375.559133:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:2.0:1784403375.653621:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403375.654927:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240941952 00000100:00100000:0.0:1784403375.654956:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240941952 00000100:00100000:0.0:1784403375.655042:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 160 00000100:00100000:0.0:1784403375.655055:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:11472:x1871082240941952:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403375.655089:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403375.655118:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb1e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed35 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.655262:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.655280:0:6293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed27 expref: 48 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.655289:0:6293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.655336:0:6293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed27 expref: 48 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.655378:0:6293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed27 expref: 48 pid: 10011 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403375.655396:0:6293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77498000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260868352:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403375.655543:0:6293:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc259c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403375.667289:0:6293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77498000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260868352:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403375.667332:0:6293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403375.670798:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403375.670927:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240942080 00000100:00100000:0.0:1784403375.670950:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240942080 00010000:00010000:0.0:1784403375.671012:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed27 expref: 49 pid: 10011 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403375.671312:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:0.0:1784403375.671327:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+49:2360:x1871082240942080:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403375.671347:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403375.671359:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed27 expref: 49 pid: 10011 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.671374:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed27 expref: 49 pid: 10011 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.671402:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb1d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed27 expref: 49 pid: 10011 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.671445:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:0.0:1784403375.671450:0:6278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.671462:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.671556:0:6278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.671640:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403375.671723:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+48:2360:x1871082240942080:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 399us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403375.671732:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 65 00010000:00010000:2.0:1784403375.677283:0:6293:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.677308:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403375.677343:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1784403375.677837:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb1e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed35 expref: 49 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.680126:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed35 expref: 48 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.680297:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:2.0:1784403375.680302:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784403375.680307:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5000, rc 0) 00000100:00100000:2.0:1784403375.680423:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+48:11472:x1871082240941952:12345-192.168.204.28@tcp:101:bash.0 Request processed in 25367us (26815us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1784403375.680434:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 160 00000100:00100000:2.0:1784403375.692488:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403375.692658:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240942336 00000100:00100000:0.0:1784403375.692670:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240942336 00000100:00100000:0.0:1784403375.692764:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 161 00000100:00100000:0.0:1784403375.692776:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+48:11472:x1871082240942336:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1784403375.698209:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.698264:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.698280:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403375.698371:0:6292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1784403375.698405:0:6292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e100074 reply state 0000000003733604 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403375.698416:0:6292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784403375.698589:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:11472:x1871082240942336:12345-192.168.204.28@tcp:36:bash.0 Request processed in 5810us (6432us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1784403375.698599:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 161 00000020:00080000:1.0:1784403375.698606:0:6292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784403375.705596:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.705622:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.705631:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.705637:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403375.705642:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.705650:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.705673:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:2.0:1784403375.705677:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403375.705682:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.705688:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afb1fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403375.710464:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403375.714563:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240942464 00000100:00100000:1.0:1784403375.714585:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240942464 00000100:00100000:1.0:1784403375.714676:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 162 00000100:00100000:1.0:1784403375.714689:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+50:11472:x1871082240942464:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1784403375.714732:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403375.714763:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb204 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed3c expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.714929:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.714955:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed35 expref: 51 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.714977:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.715025:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed35 expref: 51 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.715042:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed35 expref: 51 pid: 6293 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403375.715060:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260868480:192.168.204.28@tcp:104: 00000100:00100000:1.0:1784403375.715200:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1240 going to sleep for 11 seconds 00000100:00100000:1.0:1784403375.722962:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260868480:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403375.723007:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403375.725911:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403375.726155:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240942592 00000100:00100000:0.0:1784403375.726170:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240942592 00010000:00010000:0.0:1784403375.726228:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed35 expref: 52 pid: 6293 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403375.726277:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:0.0:1784403375.726289:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:2360:x1871082240942592:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403375.726310:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403375.726318:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed35 expref: 52 pid: 6293 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.726357:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed35 expref: 52 pid: 6293 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.726385:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb1ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed35 expref: 52 pid: 6293 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.726407:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:0.0:1784403375.726413:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.726423:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.726432:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403375.726474:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403375.726555:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:2360:x1871082240942592:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 267us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403375.726564:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 66 00010000:00010000:1.0:1784403375.728486:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.728508:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403375.728583:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1784403375.728589:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403375.728619:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.728671:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed3c expref: 51 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.728993:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed3c expref: 50 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.729004:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:1.0:1784403375.729008:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403375.729012:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1200, rc 0) 00000100:00100000:1.0:1784403375.729111:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+50:11472:x1871082240942464:12345-192.168.204.28@tcp:101:bash.0 Request processed in 14423us (18660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403375.729122:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 162 00000100:00100000:2.0:1784403375.735051:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403375.735270:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240942848 00000100:00100000:3.0:1784403375.735305:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240942848 00000100:00100000:3.0:1784403375.735375:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:3.0:1784403375.735387:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+50:11472:x1871082240942848:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1784403375.735908:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:11472:x1871082240942848:12345-192.168.204.28@tcp:35:bash.0 Request processed in 520us (871us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1784403375.735919:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:0.0:1784403375.837375:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403375.837669:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240943104 00000100:00100000:3.0:1784403375.837684:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240943104 00000100:00100000:3.0:1784403375.837815:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 163 00000100:00100000:3.0:1784403375.837830:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:11482:x1871082240943104:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403375.837897:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403375.837925:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed43 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403375.838100:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784403375.838343:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb212 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed43 expref: 53 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.838360:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:3.0:1784403375.838364:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403375.838370:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed43 expref: 53 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.838387:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403375.838535:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:11482:x1871082240943104:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 707us (1175us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1784403375.838544:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 163 00000100:00100000:1.0:1784403375.839289:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260868608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403375.839360:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1784403375.839474:0:8234:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381407606879ns, next at 382407604400ns, rc = 0 00000100:00100000:3.0:1784403375.839547:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260868608 00000100:00100000:3.0:1784403375.839555:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260868608 00000100:00100000:3.0:1784403375.839617:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784403375.839627:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3566:x1871082260868608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403375.839667:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403375.840433:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3566:x1871082260868608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 802us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403375.840444:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784403375.840708:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260868608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403375.846316:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403375.846471:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240943232 00000100:00100000:2.0:1784403375.846487:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240943232 00000100:00100000:2.0:1784403375.846583:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 164 00000100:00100000:2.0:1784403375.846618:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:11482:x1871082240943232:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:2.0:1784403375.846744:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb220 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.846767:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb220 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.846782:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb220 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.846801:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb227 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.846808:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.846814:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847010:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847021:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847028:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403375.847084:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847099:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb220 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847112:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb220 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847119:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb220 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847126:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403375.847131:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb220 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847140:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb220 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847155:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:2.0:1784403375.847158:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403375.847165:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb220 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847171:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb220 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847188:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847194:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb227 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847200:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847205:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403375.847215:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847222:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb227 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847230:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a429d0200) 00010000:00010000:2.0:1784403375.847232:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403375.847235:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb227 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847240:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb227 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847259:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847265:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847272:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847277:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403375.847280:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847287:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847295:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:2.0:1784403375.847297:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403375.847307:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403375.847313:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb22e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403375.847417:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:11482:x1871082240943232:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 801us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403375.847428:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 164 00000100:00100000:2.0:1784403375.856218:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403375.856413:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240943488 00000100:00100000:1.0:1784403375.856428:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240943488 00000100:00100000:1.0:1784403375.856710:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:1.0:1784403375.856724:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:11482:x1871082240943488:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403375.857151:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+53:11482:x1871082240943488:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 427us (945us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1784403375.857161:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00010000:00010000:1.0:1784403375.967171:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403375.967576:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403375.967732:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240943744 00000100:00100000:1.0:1784403375.967745:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240943744 00000100:00100000:1.0:1784403375.967825:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 165 00000100:00100000:1.0:1784403375.967839:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+53:11485:x1871082240943744:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403375.967939:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403375.967969:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb235 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed4a expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968079:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb23c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968099:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb23c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968111:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb23c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968128:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968135:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968142:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968316:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb24a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968326:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968333:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403375.968345:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784403375.968491:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb23c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968500:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb23c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968507:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb23c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968514:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403375.968519:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb23c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968528:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb23c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968542:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:1.0:1784403375.968546:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403375.968552:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb23c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968559:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb23c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968575:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968582:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb243 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968588:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968593:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403375.968603:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968610:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968619:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a51bd0700) 00010000:00010000:1.0:1784403375.968622:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403375.968625:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb243 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968631:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968686:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb235 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed4a expref: 56 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968702:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb24a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed4a expref: 55 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.968709:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:1.0:1784403375.968733:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403375.968736:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0800, rc 0) 00000100:00100000:1.0:1784403375.968828:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:11485:x1871082240943744:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 992us (1262us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1784403375.968837:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 165 00000100:00100000:2.0:1784403375.976393:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403375.976481:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403375.976698:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240943872 00000100:00100000:1.0:1784403375.976711:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240943872 00000100:00100000:1.0:1784403375.976805:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:1.0:1784403375.976819:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:2361:x1871082240943872:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403375.976863:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784403375.976915:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240944000 00000100:00100000:3.0:1784403375.976941:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240944000 00010000:00010000:1.0:1784403375.976952:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb24a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed4a expref: 56 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403375.976988:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:1.0:1784403375.976996:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403375.977030:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 166 00000100:00100000:3.0:1784403375.977042:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:11485:x1871082240944000:12345-192.168.204.28@tcp:54:lfs.0 00000100:00100000:1.0:1784403375.977086:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:2361:x1871082240943872:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 268us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403375.977097:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00010000:00010000:3.0:1784403375.977127:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.977161:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.977175:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.977206:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.977215:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb258 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.977223:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.977248:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403375.977264:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.977276:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.977292:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:3.0:1784403375.977296:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403375.977301:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb258 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403375.977306:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403375.977407:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:11485:x1871082240944000:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 365us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403375.977415:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 166 00000100:00100000:2.0:1784403375.986620:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403375.986811:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240944256 00000100:00100000:3.0:1784403375.986826:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240944256 00000100:00100000:3.0:1784403375.986950:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:3.0:1784403375.986963:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:11485:x1871082240944256:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1784403375.987293:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:11485:x1871082240944256:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 332us (687us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1784403375.987303:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:1.0:1784403376.212497:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403376.212631:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240944512 00000100:00100000:3.0:1784403376.212648:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240944512 00000100:00100000:3.0:1784403376.212936:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 167 00000100:00100000:3.0:1784403376.212985:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:11503:x1871082240944512:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:3.0:1784403376.213014:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403376.213038:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb25f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed51 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.213145:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb266 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.213161:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb266 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.213173:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb266 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403376.213183:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784403376.213438:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb25f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed51 expref: 58 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.213457:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb266 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed51 expref: 57 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.213465:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:3.0:1784403376.213468:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784403376.213470:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6800, rc 0) 00000100:00100000:3.0:1784403376.213543:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:11503:x1871082240944512:12345-192.168.204.28@tcp:101:cat.0 Request processed in 583us (1063us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1784403376.213552:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 167 00000100:00100000:0.0:1784403376.251785:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403376.251985:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240944640 00000100:00100000:3.0:1784403376.251996:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240944640 00000100:00100000:3.0:1784403376.252092:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 168 00000100:00100000:3.0:1784403376.252103:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7749b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:11505:x1871082240944640:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403376.252130:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403376.252164:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb274 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed58 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.252241:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb27b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.252255:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.252267:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403376.252329:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1784403376.252334:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403376.252356:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.252383:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb274 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed58 expref: 59 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.252404:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb27b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed58 expref: 58 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.252414:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403376.252417:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784403376.252421:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:3.0:1784403376.252488:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7749b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:11505:x1871082240944640:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 386us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403376.252837:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 168 00000100:00100000:2.0:1784403376.262802:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403376.262955:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240945024 00000100:00100000:3.0:1784403376.262971:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240945024 00000100:00100000:3.0:1784403376.263051:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:3.0:1784403376.263064:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:11505:x1871082240945024:12345-192.168.204.28@tcp:35:lfs.0 00000001:00080000:3.0:1784403376.263478:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967456 00000100:00100000:3.0:1784403376.263628:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11505:x1871082240945024:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 565us (845us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1784403376.263637:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00000020:00080000:3.0:1784403376.263643:0:6296:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784403376.282278:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403376.282834:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240945152 00000100:00100000:3.0:1784403376.282850:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240945152 00000100:00100000:3.0:1784403376.283005:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:3.0:1784403376.283017:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73640e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11505:x1871082240945152:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:3.0:1784403376.283040:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784403376.283076:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb20b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed3c expref: 60 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.283105:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb266 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed51 expref: 59 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.283118:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb116 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecfd expref: 58 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403376.283129:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a4884da00) 00010000:00010000:3.0:1784403376.283303:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403376.283535:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73640e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:11505:x1871082240945152:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 516us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403376.283545:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:0.0:1784403376.298097:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403376.298263:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240945280 00000100:00100000:1.0:1784403376.298277:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240945280 00000100:00100000:1.0:1784403376.298363:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 169 00000100:00100000:1.0:1784403376.298378:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:11505:x1871082240945280:12345-192.168.204.28@tcp:58:lfs.0 00010000:00010000:1.0:1784403376.298549:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb282 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.298572:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb282 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.298587:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb282 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784403376.298931:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1784403376.299065:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:11505:x1871082240945280:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 689us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403376.299076:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 169 00000100:00100000:2.0:1784403376.340306:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403376.340827:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240945408 00000100:00100000:1.0:1784403376.340860:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240945408 00000100:00100000:1.0:1784403376.340997:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 170 00000100:00100000:1.0:1784403376.341011:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:11507:x1871082240945408:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403376.341041:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403376.341071:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb289 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed5f expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341161:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb290 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341178:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341192:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341210:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb297 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341219:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341225:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341355:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341364:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341371:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403376.341433:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1784403376.341439:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403376.341466:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341482:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341491:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341498:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb290 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341506:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb290 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341513:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403376.341518:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb290 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341527:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb290 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341543:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:1.0:1784403376.341546:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403376.341552:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341559:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341587:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341594:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb297 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341600:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341606:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403376.341610:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341616:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb297 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341625:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a51bd0300) 00010000:00010000:1.0:1784403376.341627:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403376.341630:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb297 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341637:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afb297 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341674:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afb289 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed5f expref: 59 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.341689:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed5f expref: 58 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403376.342545:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a51bd0700) 00010000:00010000:1.0:1784403376.342548:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784403376.342551:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1800, rc 0) 00000100:00100000:2.0:1784403376.346553:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:11507:x1871082240945408:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5525us (6242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403376.346570:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 170 00000001:00080000:1.0:1784403376.447351:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1784403376.447380:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:0.0:1784403376.992828:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784403377.314206:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403377.314218:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784403377.314264:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784403377.314290:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784403377.314465:0:12049:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260868736:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784403377.314610:0:12049:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc25780 going to sleep for 11 seconds 00000100:00100000:1.0:1784403377.339038:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403377.339270:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240945536 00000100:00100000:3.0:1784403377.339284:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240945536 00000100:00100000:3.0:1784403377.339376:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 171 00000100:00100000:3.0:1784403377.339391:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11518:x1871082240945536:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784403377.339436:0:6294:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784403377.339582:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11518:x1871082240945536:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 195us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403377.339592:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 171 00000100:00080000:1.0:1784403377.339763:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403377.343941:0:12049:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260868736:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784403377.349402:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403377.350176:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240945664 00000100:00100000:0.0:1784403377.350191:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240945664 00000100:00100000:0.0:1784403377.350281:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00100000:0.0:1784403377.350294:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:11518:x1871082240945664:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784403377.350400:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb2a5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350422:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350437:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350457:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb2ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350474:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb2ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350482:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb2ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350516:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350527:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350534:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403377.350603:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784403377.350608:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403377.350626:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350639:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350647:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb2a5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350655:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350663:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403377.350668:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350678:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb2a5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350693:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:0.0:1784403377.350696:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403377.350702:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb2a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350708:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5a00/0x6828175665afb2a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350726:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb2ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350746:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb2ac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350752:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb2ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350757:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403377.350761:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb2ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350767:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb2ac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350775:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8c8a4884d600) 00010000:00010000:0.0:1784403377.350778:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403377.350781:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb2ac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350788:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb2ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350804:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350810:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350815:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350820:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403377.350830:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350836:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350843:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a51bd0700) 00010000:00010000:0.0:1784403377.350846:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403377.350848:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.350854:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4800/0x6828175665afb2b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403377.350993:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:11518:x1871082240945664:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 Request processed in 698us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403377.351002:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00100000:3.0:1784403377.355022:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403377.357081:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240945920 00000100:00100000:1.0:1784403377.357102:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240945920 00000100:00100000:1.0:1784403377.357200:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:1.0:1784403377.357213:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:11518:x1871082240945920:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403377.357241:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403377.357268:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb2ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed66 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357403:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb2c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357422:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357436:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403377.357448:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784403377.357575:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357605:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb2c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357612:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357619:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403377.357624:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357632:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb2c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357646:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a51bd0700) 00010000:00010000:1.0:1784403377.357649:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784403377.357654:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb2c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357660:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb2c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357709:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb2ba lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed66 expref: 60 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357720:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:1.0:1784403377.357722:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784403377.357726:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb2ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed66 expref: 60 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.357736:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0e00, rc 0) 00000100:00100000:1.0:1784403377.357822:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11518:x1871082240945920:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 612us (2817us total) trans 4294967458 rc 301/301 00000100:00100000:1.0:1784403377.357831:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:3.0:1784403377.361117:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403377.361679:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240946048 00000100:00100000:0.0:1784403377.361694:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240946048 00000100:00100000:0.0:1784403377.365234:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 174 00000100:00100000:0.0:1784403377.365260:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11518:x1871082240946048:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784403377.365314:0:6293:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784403377.365476:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11518:x1871082240946048:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 226us (4374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403377.365484:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 174 00000100:00100000:3.0:1784403377.374213:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403377.374508:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240946304 00000100:00100000:1.0:1784403377.374527:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240946304 00000100:00100000:1.0:1784403377.374606:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 175 00000100:00100000:1.0:1784403377.374618:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11518:x1871082240946304:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403377.374646:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403377.374650:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784403377.374684:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb27b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed58 expref: 59 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.374707:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:1.0:1784403377.374713:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784403377.374731:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb2cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed6d expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784403377.375358:0:6294:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1784403377.375630:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb2d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.375649:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.375662:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.375726:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb2cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed6d expref: 61 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.375768:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed6d expref: 60 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.375778:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a51bd0900) 00010000:00010000:1.0:1784403377.375781:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403377.375783:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0400, rc 0) 00000100:00100000:1.0:1784403377.375947:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11518:x1871082240946304:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 1325us (1745us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1784403377.375959:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 175 00000100:00100000:1.0:1784403377.381729:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403377.385189:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240946560 00000100:00100000:2.0:1784403377.385208:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240946560 00000100:00100000:2.0:1784403377.385311:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 176 00000100:00100000:2.0:1784403377.385323:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11518:x1871082240946560:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784403377.385406:0:10011:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403377.385453:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb2d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed6d expref: 60 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.385473:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a51bd0900) 00010000:00010000:2.0:1784403377.385485:0:10011:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403377.385515:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb2e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.385532:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb2e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.385544:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb2e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387177:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb2eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xae4f61a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387201:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb2eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xae4f61a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387214:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb2eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xae4f61a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387299:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb2e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387307:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb2e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387315:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb2e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387321:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403377.387332:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb2e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387340:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb2e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387352:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:2.0:1784403377.387355:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403377.387359:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb2e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387365:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb2e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387379:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb2eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xae4f61a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387385:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb2eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae4f61a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387390:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb2eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae4f61a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387395:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403377.387398:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb2eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae4f61a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387403:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb2eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae4f61a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387409:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xae4f61a5 (ffff8c8a429d0400) 00010000:00010000:2.0:1784403377.387412:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403377.387420:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb2eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xae4f61a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.387425:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb2eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xae4f61a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.387731:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11518:x1871082240946560:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 2404us (6012us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784403377.387741:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 176 00000100:00100000:1.0:1784403377.394343:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403377.394429:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240946688 00000100:00100000:3.0:1784403377.394446:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240946688 00000100:00100000:3.0:1784403377.394646:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00100000:3.0:1784403377.394659:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11518:x1871082240946688:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403377.394695:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403377.394725:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb2f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed74 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.394762:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.394776:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.394788:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.395249:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb2f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed74 expref: 61 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.395272:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed74 expref: 60 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.395281:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:3.0:1784403377.395285:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784403377.395288:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403377.395372:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11518:x1871082240946688:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 716us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403377.395381:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00100000:0.0:1784403377.409651:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403377.409795:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240946944 00000100:00100000:2.0:1784403377.409809:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240946944 00000100:00100000:2.0:1784403377.409921:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 178 00000100:00100000:2.0:1784403377.409935:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11518:x1871082240946944:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784403377.410056:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.410078:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.410094:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784403377.410496:0:10011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1784403377.410508:0:10011:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382978641574ns, next at 383978638862ns, rc = 0 00000004:00010000:2.0:1784403377.410647:0:10011:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001dd08192 reply state 0000000060b4834b transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.410660:0:10011:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784403377.410812:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+62:11518:x1871082240946944:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 879us (1175us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1784403377.410839:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 178 00000100:00100000:1.0:1784403377.431239:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1784403377.431295:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.431308:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.431316:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.431324:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403377.431330:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.431338:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403377.431347:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240947072 00000100:00100000:0.0:1784403377.431364:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240947072 00010000:00010000:1.0:1784403377.431381:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:1.0:1784403377.431387:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784403377.431393:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.431401:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb300 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403377.431459:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 179 00000100:00100000:0.0:1784403377.431476:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7751ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:11518:x1871082240947072:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784403377.431520:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403377.431546:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb307 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed7b expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.431634:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb307 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed7b expref: 62 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.431652:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb307 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed7b expref: 62 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.431673:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:0.0:1784403377.431676:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784403377.431680:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4000, rc 0) 00000100:00100000:0.0:1784403377.431773:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7751ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+62:11518:x1871082240947072:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 302us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403377.431781:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 179 00000100:00100000:0.0:1784403377.443123:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403377.444456:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240947200 00000100:00100000:3.0:1784403377.444471:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240947200 00000100:00080000:3.0:1784403377.444936:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403377.444985:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:2.0:1784403377.445005:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240947200:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784403377.445511:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2358:x1871082240947200:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 509us (2399us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1784403377.445521:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:0.0:1784403377.457144:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403377.459316:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240947456 00000100:00100000:1.0:1784403377.459334:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240947456 00000100:00100000:1.0:1784403377.459425:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:1.0:1784403377.459438:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+62:11518:x1871082240947456:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784403377.459720:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+63:11518:x1871082240947456:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 284us (2591us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1784403377.459731:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:0.0:1784403377.467782:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403377.467920:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240947712 00000100:00100000:2.0:1784403377.467934:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240947712 00000100:00100000:2.0:1784403377.468009:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 180 00000100:00100000:2.0:1784403377.468034:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+63:11518:x1871082240947712:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784403377.468209:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+63:11518:x1871082240947712:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 177us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403377.468217:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 180 00000100:00100000:0.0:1784403377.477963:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403377.478075:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240947840 00000100:00100000:0.0:1784403377.478155:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240947840 00000100:00100000:0.0:1784403377.478213:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 181 00000100:00100000:0.0:1784403377.478225:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+63:11518:x1871082240947840:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784403377.478247:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403377.478267:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb30e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed82 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.478421:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb315 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.478750:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.478768:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403377.478809:0:6294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403377.478830:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.478857:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afb30e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed82 expref: 65 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.478910:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed82 expref: 64 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.478921:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:0.0:1784403377.478925:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784403377.478928:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5400, rc 0) 00000100:00100000:0.0:1784403377.479158:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+64:11518:x1871082240947840:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 934us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403377.479167:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 181 00000100:00100000:2.0:1784403377.489191:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403377.489300:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240947968 00000100:00100000:1.0:1784403377.489312:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240947968 00000100:00100000:1.0:1784403377.489370:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:1.0:1784403377.489381:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240947968:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403377.489400:0:7101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403377.489434:0:7101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb31c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed89 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784403377.489462:0:7101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bd5b1, blocks: 0x1 00010000:00010000:1.0:1784403377.489481:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1784403377.489487:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403377.489505:0:7101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb31c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed89 expref: 8 pid: 7101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.489525:0:7101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb31c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed89 expref: 8 pid: 7101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.489540:0:7101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0000, rc 0) 00000100:00100000:1.0:1784403377.489660:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240947968:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 280us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403377.489667:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00000040:00080000:0.0:1784403377.496165:0:12877:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403377.496176:0:12877:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784403377.496577:0:12877:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1784403377.496585:0:12877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784403377.500444:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403377.500531:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240948224 00000100:00100000:3.0:1784403377.500544:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240948224 00000100:00100000:3.0:1784403377.500622:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 182 00000100:00100000:3.0:1784403377.500635:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+64:11518:x1871082240948224:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784403377.500749:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+64:11518:x1871082240948224:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 116us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403377.500758:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 182 00000100:00100000:0.0:1784403377.509027:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403377.509215:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240948352 00000100:00100000:2.0:1784403377.509225:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240948352 00000100:00100000:2.0:1784403377.509280:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:2.0:1784403377.509290:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:11518:x1871082240948352:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784403377.509310:0:8571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403377.509330:0:8571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed90 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.509365:0:8571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb31c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed89 expref: 9 pid: 7101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.509384:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403377.509389:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403377.509395:0:8571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 9 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.509433:0:8571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb31c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed89 expref: 9 pid: 7101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.509448:0:8571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb31c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed89 expref: 9 pid: 7101 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.509464:0:8571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8571:1871082260868864:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403377.509560:0:8571:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4571b780 going to sleep for 11 seconds 00000100:00100000:0.0:1784403377.518262:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403377.518370:0:8571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8571:1871082260868864:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403377.518411:0:8571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 9 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.518436:0:8571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2800, rc 0) 00000100:00100000:1.0:1784403377.518500:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:11518:x1871082240948352:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 9211us (9480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403377.518510:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240948480 00000100:00100000:1.0:1784403377.518510:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:2.0:1784403377.518517:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240948480 00010000:00010000:2.0:1784403377.518550:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb31c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed89 expref: 9 pid: 7101 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.518588:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:2.0:1784403377.518597:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2360:x1871082240948480:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403377.518613:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403377.518639:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb31c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed89 expref: 9 pid: 7101 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.518747:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb31c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed89 expref: 9 pid: 7101 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.518772:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb31c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed89 expref: 9 pid: 7101 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.518785:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403377.518790:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403377.518798:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 8 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.518809:0:6276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 8 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.518844:0:6276:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 8 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.518859:0:6276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6276:1871082260868992:192.168.204.28@tcp:105: 00000100:00100000:2.0:1784403377.525472:0:6276:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4571bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403377.536809:0:6276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6276:1871082260868992:192.168.204.28@tcp:105: 00010000:00010000:2.0:1784403377.536837:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403377.536921:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240948480:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 18324us (18670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403377.536932:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:1.0:1784403377.539130:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403377.539196:0:7106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240948608 00000100:00100000:0.0:1784403377.539206:0:7106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240948608 00002000:00100000:0.0:1784403377.539255:0:7106:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8c8a73607100 x1871082240948608/t0(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:148/0 lens 504/0 e 0 to 0 dl 1784403388 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784403377.539266:0:7106:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a73607100 with x1871082240948608 ext(0->8) 00002000:00010000:0.0:1784403377.539271:0:7106:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a73607100 00000100:00100000:0.0:1784403377.539337:0:7106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:0.0:1784403377.539347:0:7106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240948608:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784403377.539815:0:7106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:2360:x1871082240948608:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 Request processed in 467us (691us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1784403377.539824:0:7106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00002000:00100000:0.0:1784403377.539831:0:7106:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8c8a73607100 x1871082240948608/t4294967314(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:148/0 lens 504/448 e 0 to 0 dl 1784403388 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784403377.539840:0:7106:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a73607100 with x1871082240948608 ext(0->8) 00002000:00010000:0.0:1784403377.539844:0:7106:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a73607100 00000100:00100000:1.0:1784403377.557201:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403377.557304:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240948736 00000100:00100000:3.0:1784403377.557315:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240948736 00000100:00100000:3.0:1784403377.557383:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 183 00000100:00100000:3.0:1784403377.557396:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+64:11518:x1871082240948736:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1784403377.611153:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000001:00080000:0.0:1784403377.611195:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:0.0:1784403377.611229:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1784403377.611254:0:6314:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c8a65fb1900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1784403377.611260:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a7311df00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a65fb1cc0 00000020:00080000:0.0:1784403377.611263:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a7311d400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a77e96400 00000004:00080000:0.0:1784403377.611277:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:0.0:1784403377.611292:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1784403377.611388:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:11518:x1871082240948736:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 Request processed in 53990us (54192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403377.611481:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a730d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260869120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784403377.611632:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403377.611711:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260869120 00000100:00100000:0.0:1784403377.611718:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260869120 00000100:00100000:0.0:1784403377.611774:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784403377.611783:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260869120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1784403377.611972:0:7101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784403377.611977:0:7101:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784403377 00002000:00010000:0.0:1784403377.611979:0:7101:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784403377.611982:0:7101:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784403377 -> 1784403377 00002000:00010000:0.0:1784403377.611984:0:7101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784403377.612010:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 183 00000100:00100000:0.0:1784403377.612014:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3567:x1871082260869120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (383us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1784403377.612020:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000020:00080000:3.0:1784403377.612034:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1784403377.612036:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260869248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784403377.612062:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1784403377.612117:0:3567:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a730d7b80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1784403377.612123:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a730d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260869120:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1784403377.612282:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:3.0:1784403377.612402:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403377.612416:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260869248 00000100:00100000:3.0:1784403377.612420:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260869248 00000100:00100000:3.0:1784403377.612464:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784403377.612472:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260869248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784403377.612492:0:7102:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1784403377.612523:0:7102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a5bd5ae, atime: 0x6a5bd5ae, ctime: 0x6a5bd5ae, blocks: 0xb 00010000:00010000:3.0:1784403377.612531:0:7102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef864e2c/0x6828175665afb32a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.612548:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1784403377.612552:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403377.612560:0:7102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef864e2c/0x6828175665afb32a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.612588:0:7102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef864e2c/0x6828175665afb32a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.612599:0:7102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef864e2c/0x6828175665afb32a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.612607:0:7102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef864e2c/0x6828175665afb32a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.612636:0:7102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784403377.613511:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784403377.613522:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef864e2c/0x6828175665afb32a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.613533:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7e00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:2.0:1784403377.613538:0:6279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef864e2c/0x6828175665afb32a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.613548:0:6279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef864e2c/0x6828175665afb32a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.613577:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef864e2c/0x6828175665afb32a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.613585:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef864e2c/0x6828175665afb32a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.613608:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403377.613609:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403377.613611:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784403377.615342:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403377.616652:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3568:x1871082260869248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4175us (4582us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1784403377.616665:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784403377.617034:0:3568:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1784403377.617041:0:3568:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1784403377.617071:0:3568:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8c8a73604700 x1871082260869248/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784403393 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1784403377.617083:0:3568:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a73604700/2, rc 0, transno 4294967307 00000100:00100000:0.0:1784403377.617092:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260869248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784403377.624646:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403377.624728:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240948864 00000100:00100000:3.0:1784403377.624739:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240948864 00000100:00100000:3.0:1784403377.624797:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:3.0:1784403377.624808:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:2358:x1871082240948864:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784403377.671165:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:2358:x1871082240948864:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 Request processed in 46344us (46512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403377.671186:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00000001:00080000:0.0:1784403377.671224:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1784403377.671233:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1784403377.674656:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403377.674816:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240949120 00000100:00100000:0.0:1784403377.674827:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240949120 00000100:00100000:0.0:1784403377.674977:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 184 00000100:00100000:0.0:1784403377.674990:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:11518:x1871082240949120:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784403377.675040:0:6293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403377.675067:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb315 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed82 expref: 18 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.675086:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:0.0:1784403377.675091:0:6293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403377.675130:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.675145:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.675154:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784403377.675386:0:6293:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000edcffbf4 reply state 000000003397b705 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403377.675395:0:6293:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784403377.675499:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:11518:x1871082240949120:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 511us (851us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1784403377.675517:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 184 00000100:00100000:2.0:1784403377.678937:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1784403377.679566:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.679580:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.679588:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.679594:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403377.679599:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.679606:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.679626:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:3.0:1784403377.679630:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403377.679634:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.679652:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb331 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403377.680023:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240949248 00000100:00100000:0.0:1784403377.680034:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240949248 00000100:00100000:0.0:1784403377.680132:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:0.0:1784403377.680143:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240949248:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784403377.680384:0:7102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784403377.680388:0:7102:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1784403377 -> 1784403376 00002000:00010000:0.0:1784403377.680390:0:7102:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784403374 00002000:00010000:0.0:1784403377.680392:0:7102:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784403377 -> 1784403376 00002000:00010000:0.0:1784403377.680394:0:7102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1784403377.680483:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2361:x1871082240949248:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 318us (1532us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784403377.680491:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:2.0:1784403377.682806:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403377.683187:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240949504 00000100:00100000:0.0:1784403377.683198:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240949504 00000100:00100000:0.0:1784403377.683299:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 185 00000100:00100000:0.0:1784403377.683309:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:11518:x1871082240949504:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784403377.683381:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.683399:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed74 expref: 18 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.683408:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.683459:0:6294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed74 expref: 18 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403377.683473:0:6294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed74 expref: 18 pid: 6294 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403377.683488:0:6294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a730d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260869376:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403377.683584:0:6294:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403377.691834:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403377.691912:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240949632 00000100:00100000:2.0:1784403377.691923:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240949632 00010000:00010000:2.0:1784403377.691977:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed74 expref: 19 pid: 6294 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.692031:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:2.0:1784403377.692042:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:2361:x1871082240949632:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403377.692057:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403377.692064:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed74 expref: 19 pid: 6294 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.692077:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed74 expref: 19 pid: 6294 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.692100:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:2.0:1784403377.692104:0:6277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.692128:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.692136:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.692157:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403377.692224:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:2361:x1871082240949632:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 183us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403377.692232:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 68 00010000:00010000:2.0:1784403377.693634:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb2f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed74 expref: 18 pid: 6294 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.693657:0:6294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a730d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260869376:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403377.693705:0:6294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.693716:0:6294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.693722:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.693756:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.693763:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.693771:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.693777:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403377.693782:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.693789:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.693805:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:2.0:1784403377.693808:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784403377.693811:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.693817:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb338 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.693923:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:11518:x1871082240949504:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 Request processed in 10614us (11124us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784403377.693933:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 185 00000100:00100000:2.0:1784403377.699824:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403377.704794:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240949760 00000100:00100000:1.0:1784403377.704808:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240949760 00000100:00100000:1.0:1784403377.704889:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:1.0:1784403377.704909:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240949760:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784403377.704954:0:7099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.704973:0:7099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 8 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.704981:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403377.704986:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784403377.704991:0:7099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.705027:0:7099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 8 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.705042:0:7099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 8 pid: 8571 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403377.705057:0:7099:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73605880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7099:1871082260869504:192.168.204.28@tcp:104: 00000100:00100000:1.0:1784403377.705153:0:7099:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403377.710409:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403377.711055:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240949888 00000100:00100000:2.0:1784403377.711066:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240949888 00010000:00010000:2.0:1784403377.711108:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 9 pid: 8571 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.711145:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:2.0:1784403377.711154:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2361:x1871082240949888:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403377.711171:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403377.711192:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 9 pid: 8571 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.711206:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 9 pid: 8571 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.711234:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784403377.711238:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784403377.711245:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.711255:0:6276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.711292:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403377.711343:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2361:x1871082240949888:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 189us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403377.711350:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 69 00010000:00010000:3.0:1784403377.713760:0:7099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afb323 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed90 expref: 8 pid: 8571 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403377.713785:0:7099:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73605880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7099:1871082260869504:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403377.713810:0:7099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.713822:0:7099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.713830:0:7099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.713887:0:7099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.713907:0:7099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.713917:0:7099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.713948:0:7099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403377.713953:0:7099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.713962:0:7099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.713980:0:7099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.713988:0:7099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067d39bcf/0x6828175665afb33f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403377.714075:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240949760:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 Request processed in 9178us (14264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403377.714086:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:1.0:1784403377.718550:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403377.718610:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240950144 00000100:00100000:3.0:1784403377.718620:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240950144 00000100:00100000:3.0:1784403377.719230:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 186 00000100:00100000:3.0:1784403377.719242:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+17:11518:x1871082240950144:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784403377.719325:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb346 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.719345:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.719373:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.719605:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.719618:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb307 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed7b expref: 18 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.719627:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.719669:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb307 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed7b expref: 18 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.721235:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb307 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed7b expref: 18 pid: 6292 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403377.721257:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af41880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260869632:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403377.721356:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a5856d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403377.723976:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403377.725229:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240950400 00000100:00100000:2.0:1784403377.725241:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240950400 00000100:00080000:0.0:1784403377.725280:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784403377.725375:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403377.725405:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403377.725439:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:2.0:1784403377.725455:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240950400:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403377.725530:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240950400:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 79us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403377.727162:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240950272 00000100:00100000:0.0:1784403377.727174:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240950272 00000100:00100000:0.0:1784403377.727227:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 299 00000100:00100000:0.0:1784403377.727237:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2358:x1871082240950272:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403377.727306:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2358:x1871082240950272:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 70us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403377.727314:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 299 00000100:00100000:2.0:1784403377.727648:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:3.0:1784403377.729909:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240950528 00000100:00100000:3.0:1784403377.729922:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240950528 00000100:00100000:3.0:1784403377.729997:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 158 00000100:00100000:3.0:1784403377.730006:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2358:x1871082240950528:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403377.730083:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2358:x1871082240950528:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 78us (4676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403377.730090:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 158 00000100:00080000:1.0:1784403377.730578:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403377.730763:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af41880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260869632:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403377.730790:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.733430:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403377.733505:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240950656 00000100:00100000:1.0:1784403377.733515:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240950656 00010000:00010000:1.0:1784403377.733569:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb307 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed7b expref: 19 pid: 6292 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403377.733611:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:1.0:1784403377.733622:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:2360:x1871082240950656:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403377.733637:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403377.733644:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb307 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed7b expref: 19 pid: 6292 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.733656:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb307 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed7b expref: 19 pid: 6292 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.733690:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb307 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed7b expref: 19 pid: 6292 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.733705:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:1.0:1784403377.733711:0:6278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.733722:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.733730:0:6278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.733754:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403377.733806:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:2360:x1871082240950656:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 186us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403377.733813:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 70 00010000:00010000:3.0:1784403377.734006:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.734014:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784403377.734216:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1784403377.734378:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1784403377.734422:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1784403377.734504:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260869760:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784403377.734556:0:10011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403377.734590:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410af540 going to sleep for 11 seconds 00000100:00100000:0.0:1784403377.734591:0:6297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260869760 00000100:00100000:0.0:1784403377.734595:0:6297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260869760 00000100:00100000:0.0:1784403377.736818:0:6297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784403377.736836:0:6297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10011:x1871082260869760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784403377.737136:0:6297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10011:x1871082260869760:12345-0@lo:1000:mdt00_003.0 Request processed in 307us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403377.737144:0:6297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784403377.737952:0:10011:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1784403377.737960:0:10011:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a730d7b80, transno 4294967315 00000100:00100000:3.0:1784403377.737995:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260869760:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1784403377.738493:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1784403377.738578:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260869888:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784403377.738631:0:10011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403377.738655:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a453509c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403377.738994:0:6298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260869888 00000100:00100000:2.0:1784403377.739002:0:6298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260869888 00000100:00100000:2.0:1784403377.739049:0:6298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784403377.739058:0:6298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10011:x1871082260869888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784403377.739233:0:6298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10011:x1871082260869888:12345-0@lo:1000:mdt00_003.0 Request processed in 176us (600us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1784403377.739240:0:6298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784403377.739280:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260869888:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1784403377.739326:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739336:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739343:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739348:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403377.739353:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739361:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739376:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a43245f00) 00010000:00010000:2.0:1784403377.739379:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784403377.739382:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739388:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb34d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739418:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb282 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739424:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb282 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739429:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb282 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739443:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403377.739446:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb282 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739452:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb282 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739460:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a51bd0700) 00010000:00010000:2.0:1784403377.739463:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784403377.739466:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb282 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739472:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0800/0x6828175665afb282 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739496:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739510:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed5f expref: 21 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739519:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739546:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed5f expref: 21 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403377.739562:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed5f expref: 21 pid: 10011 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403377.739588:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260870016:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403377.739656:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4571b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784403377.745785:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403377.746919:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240950784 00000100:00100000:1.0:1784403377.746932:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240950784 00010000:00010000:1.0:1784403377.746976:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed5f expref: 22 pid: 10011 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403377.747014:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:1.0:1784403377.747024:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73640e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+22:2361:x1871082240950784:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403377.747040:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403377.747047:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed5f expref: 22 pid: 10011 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.747060:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed5f expref: 22 pid: 10011 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.747083:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a51bd0700) 00010000:00010000:1.0:1784403377.747088:0:6277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.747098:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.747105:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.747138:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403377.747196:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73640e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+22:2361:x1871082240950784:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 174us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403377.747204:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 71 00010000:00010000:3.0:1784403377.747444:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1800/0x6828175665afb29e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed5f expref: 21 pid: 10011 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403377.747460:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260870016:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403377.747493:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747503:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747525:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747539:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747546:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747554:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747560:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403377.747565:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747572:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747582:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a51bd0700) 00010000:00010000:3.0:1784403377.747585:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403377.747588:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747594:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb354 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747605:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747612:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb346 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747625:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747630:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403377.747633:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747640:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb346 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747647:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a51bd0700) 00010000:00010000:3.0:1784403377.747650:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784403377.747652:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb346 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.747657:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb346 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403377.748076:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:11518:x1871082240950144:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 28833us (29535us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1784403377.748085:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 186 00000020:00080000:3.0:1784403377.748089:0:10011:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784403377.748437:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784403377.748443:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784403377.748978:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1784403377.748987:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784403377.753664:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403377.753750:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240951040 00000100:00100000:1.0:1784403377.753774:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240951040 00000100:00100000:1.0:1784403377.753841:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:1.0:1784403377.753852:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:11518:x1871082240951040:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784403377.754661:0:6296:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784403377.754777:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1784403377.754827:0:6296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.754843:0:6296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.754854:0:6296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.754886:0:6296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.754904:0:6296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.754911:0:6296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403377.754939:0:6296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784403377.755037:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+22:11518:x1871082240951040:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 1184us (1381us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1784403377.755047:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00000020:00080000:1.0:1784403377.755052:0:6296:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784403377.755457:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403377.755475:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.755484:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1200 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403377.755489:0:6280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.755509:0:6280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.755526:0:6280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c8a51bd0000) 00010000:00010000:3.0:1784403377.755529:0:6280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784403377.755534:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.755540:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1200/0x6828175665afb35b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403377.755559:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403377.755561:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403377.755563:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403378.017721:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403378.399294:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260870144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403378.399398:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403378.404537:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260870144 00000100:00100000:3.0:1784403378.404555:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260870144 00000100:00100000:3.0:1784403378.404637:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784403378.404648:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260870144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784403378.404677:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1784403378.408323:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260870144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3666us (8913us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403378.408341:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784403378.408380:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260870144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784403379.039057:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784403379.307596:0:12929:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784403379.307605:0:12929:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784403379.308068:0:12929:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1784403379.308078:0:12929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784403379.413043:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403379.413110:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240951296 00000100:00100000:2.0:1784403379.413120:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240951296 00000100:00100000:2.0:1784403379.413192:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 187 00000100:00100000:2.0:1784403379.413204:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+22:11536:x1871082240951296:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403379.413229:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403379.413249:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb362 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed97 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784403379.413304:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784403379.413512:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb369 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.413528:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.413539:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403379.413559:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1784403379.413974:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb362 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed97 expref: 25 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.413994:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed97 expref: 24 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.414013:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403379.414016:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784403379.414020:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3400, rc 0) 00000100:00100000:3.0:1784403379.414084:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:11536:x1871082240951296:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 882us (1063us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1784403379.414092:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 187 00000100:00100000:0.0:1784403379.419295:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.419427:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240951424 00000100:00100000:3.0:1784403379.419438:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240951424 00000100:00100000:3.0:1784403379.419545:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 188 00000100:00100000:3.0:1784403379.419557:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:11536:x1871082240951424:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:3.0:1784403379.419653:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb377 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.419670:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.419682:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.419698:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb37e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.419705:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.419711:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420313:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420325:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420333:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784403379.420378:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420391:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420397:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb377 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420403:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb377 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420410:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.420414:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb377 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420422:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb377 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420435:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403379.420438:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.420443:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb377 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420457:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb377 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420484:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420491:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb37e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420496:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb37e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420501:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.420504:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb37e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420510:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb37e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420519:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403379.420522:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.420525:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb37e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420530:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb37e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420544:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420549:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420563:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420569:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.420572:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420578:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420587:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403379.420589:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.420592:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.420598:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403379.420820:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:11536:x1871082240951424:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 1262us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403379.420829:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 188 00000100:00100000:2.0:1784403379.498112:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.498185:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240951680 00000100:00100000:3.0:1784403379.498195:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240951680 00000100:00100000:3.0:1784403379.498246:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 189 00000100:00100000:3.0:1784403379.498256:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:11539:x1871082240951680:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403379.498278:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403379.498302:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb38c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ed9e expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.498389:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb393 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.498406:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.498420:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.498436:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb39a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.498443:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb39a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.498449:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb39a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.498813:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.498822:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.498829:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403379.498839:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784403379.498983:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.498991:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb393 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499002:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499008:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.499012:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499018:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb393 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499029:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403379.499032:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.499035:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb393 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499041:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb393 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499053:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb39a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499058:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb39a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499064:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb39a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499068:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.499070:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb39a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499083:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb39a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499091:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403379.499093:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.499097:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb39a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499103:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb39a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499144:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb38c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed9e expref: 27 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499158:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed9e expref: 26 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.499166:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403379.499168:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403379.499170:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:3.0:1784403379.499238:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:11539:x1871082240951680:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 983us (1136us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1784403379.499246:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 189 00000100:00100000:1.0:1784403379.502490:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.502629:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240951808 00000100:00100000:3.0:1784403379.502640:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240951808 00000100:00100000:3.0:1784403379.502743:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 190 00000100:00100000:3.0:1784403379.502756:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:11539:x1871082240951808:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:3.0:1784403379.502841:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.502904:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.502918:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.502946:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.502953:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.502960:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.502967:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.502972:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.502980:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.502990:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403379.502993:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403379.502998:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.503005:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403379.503098:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:11539:x1871082240951808:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 343us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403379.503105:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 190 00000100:00100000:2.0:1784403379.510284:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403379.512823:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240952064 00000100:00100000:1.0:1784403379.512839:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240952064 00000100:00100000:1.0:1784403379.512929:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:1.0:1784403379.512940:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:11539:x1871082240952064:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403379.513192:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:11539:x1871082240952064:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 253us (2914us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1784403379.513199:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:2.0:1784403379.561400:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403379.561438:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240952320 00000100:00100000:2.0:1784403379.561448:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240952320 00000100:00100000:2.0:1784403379.561846:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 191 00000100:00100000:2.0:1784403379.561857:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:11065:x1871082240952320:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1784403379.561907:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403379.561927:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb3b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eda5 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.562023:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.562040:0:6292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed9e expref: 28 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.562049:0:6292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.562099:0:6292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed9e expref: 28 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.562113:0:6292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed9e expref: 28 pid: 6292 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403379.562128:0:6292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6292:1871082260870272:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403379.562216:0:6292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403379.568330:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.568488:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240952448 00000100:00100000:3.0:1784403379.568497:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240952448 00010000:00010000:3.0:1784403379.568541:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed9e expref: 29 pid: 6292 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403379.568577:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:2.0:1784403379.568778:0:6292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6292:1871082260870272:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403379.568801:0:6292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403379.569360:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:2361:x1871082240952448:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403379.569377:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403379.569385:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed9e expref: 29 pid: 6292 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.569400:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed9e expref: 29 pid: 6292 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.569423:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed9e expref: 29 pid: 6292 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.569436:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403379.569440:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.569449:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.569469:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.569504:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403379.569561:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:2361:x1871082240952448:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 206us (1241us total) trans 0 rc 0/0 00010000:00010000:1.0:1784403379.569606:0:6292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.569624:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403379.569642:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1784403379.569790:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb3b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eda5 expref: 30 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.569807:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eda5 expref: 29 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.569815:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:1.0:1784403379.569817:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784403379.569820:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3200, rc 0) 00000100:00100000:1.0:1784403379.569846:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:11065:x1871082240952320:12345-192.168.204.28@tcp:101:bash.0 Request processed in 7992us (8458us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1784403379.569854:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 191 00000100:00100000:3.0:1784403379.571029:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:2.0:1784403379.573060:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.573158:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240952704 00000100:00100000:3.0:1784403379.573169:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240952704 00000100:00100000:3.0:1784403379.573229:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 192 00000100:00100000:3.0:1784403379.573240:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:11065:x1871082240952704:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1784403379.573614:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.573632:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.573706:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784403379.573766:0:6294:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1784403379.573794:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6304b80 reply state 000000004589767f transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403379.573804:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1784403379.573855:0:6294:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1784403379.574035:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+32:11065:x1871082240952704:12345-192.168.204.28@tcp:36:bash.0 Request processed in 794us (982us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1784403379.574043:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 192 00000020:00080000:3.0:1784403379.574062:0:6294:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1784403379.576044:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.576060:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.576068:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.576074:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.576079:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.576086:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.576101:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403379.576105:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.576110:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.576116:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403379.576676:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.576917:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240952832 00000100:00100000:3.0:1784403379.576926:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240952832 00000100:00100000:3.0:1784403379.576976:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 193 00000100:00100000:3.0:1784403379.576986:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:11065:x1871082240952832:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403379.577010:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403379.577028:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890edac expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.577104:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edac expref: 32 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.577119:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edac expref: 32 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.577137:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403379.577141:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403379.577143:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:3.0:1784403379.577204:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+32:11065:x1871082240952832:12345-192.168.204.28@tcp:101:bash.0 Request processed in 219us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403379.577212:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 193 00000100:00100000:2.0:1784403379.579511:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403379.579569:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240952960 00000100:00100000:0.0:1784403379.579578:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240952960 00000100:00100000:0.0:1784403379.579675:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:0.0:1784403379.579686:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:11065:x1871082240952960:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403379.579718:0:7101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403379.579741:0:7101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afb3d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890edb3 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784403379.579767:0:7101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5bd5b0, atime: 0x6a5bd5ae, ctime: 0x6a5bd5b0, blocks: 0xb 00010000:00010000:0.0:1784403379.579789:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1784403379.579794:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403379.579803:0:7101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afb3d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edb3 expref: 8 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.579823:0:7101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afb3d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edb3 expref: 8 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.579837:0:7101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4c00, rc 0) 00000100:00080000:1.0:1784403379.579854:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403379.579926:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:11065:x1871082240952960:12345-192.168.204.28@tcp:101:bash.0 Request processed in 242us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403379.579933:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:0.0:1784403379.583387:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.583480:0:7105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240953088 00000100:00100000:3.0:1784403379.583489:0:7105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240953088 00002000:00010000:3.0:1784403379.583536:0:7105:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1784403379.583540:0:7105:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a730d5880 with x1871082240953088 ext(0->18446744073709551615) 00002000:00010000:3.0:1784403379.583554:0:7105:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a730d5880. 00000100:00100000:3.0:1784403379.583619:0:7105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:3.0:1784403379.583629:0:7105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2358:x1871082240953088:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1784403379.583952:0:7105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784403379.583956:0:7105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1784403376 -> 1784403379 00002000:00010000:3.0:1784403379.583958:0:7105:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1784403374 -> 1784403374 00002000:00010000:3.0:1784403379.583961:0:7105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784403376 -> 1784403379 00002000:00010000:3.0:1784403379.583963:0:7105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1784403379.584015:0:7105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2358:x1871082240953088:12345-192.168.204.28@tcp:10:bash.0 Request processed in 387us (638us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1784403379.584036:0:7105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00002000:00010000:3.0:1784403379.584040:0:7105:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1784403379.584043:0:7105:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a730d5880 with x1871082240953088 ext(0->18446744073709551615) 00002000:00010000:3.0:1784403379.584048:0:7105:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a730d5880. 00000100:00100000:2.0:1784403379.628483:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403379.628731:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240953216 00000100:00100000:0.0:1784403379.628754:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240953216 00000100:00100000:0.0:1784403379.628819:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 194 00000100:00100000:0.0:1784403379.628832:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+32:11553:x1871082240953216:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:0.0:1784403379.629059:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb3e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629080:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb3e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629094:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb3e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629110:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb3e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629117:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629124:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629406:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629416:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629425:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784403379.629472:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629496:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb3e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629502:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb3e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629509:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb3e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629515:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403379.629519:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb3e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629527:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb3e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629540:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:0.0:1784403379.629543:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403379.629547:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb3e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629554:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb3e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629567:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629574:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb3e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629580:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629592:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403379.629596:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629603:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb3e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629624:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a4884da00) 00010000:00010000:0.0:1784403379.629627:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403379.629630:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb3e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629637:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb3e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629652:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629659:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629665:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629670:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403379.629673:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629678:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629696:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:0.0:1784403379.629699:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403379.629702:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.629708:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb3ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403379.629844:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+32:11553:x1871082240953216:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 1012us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403379.629852:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 194 00000100:00100000:0.0:1784403379.663330:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.664946:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240953472 00000100:00100000:3.0:1784403379.664959:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240953472 00000100:00100000:3.0:1784403379.665444:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 195 00000100:00100000:3.0:1784403379.665456:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+32:11556:x1871082240953472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403379.665477:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403379.665501:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890edba expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.665577:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb3fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.665593:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb3fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.665605:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb3fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.665620:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb403 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.665627:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.665633:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.666828:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb40a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.666844:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.666853:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403379.666897:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784403379.667365:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb3fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667374:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb3fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667381:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb3fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667387:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.667391:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb3fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667399:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb3fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667412:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403379.667415:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.667419:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb3fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667438:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb3fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667454:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667460:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb403 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667466:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb403 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667472:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.667475:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb403 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667482:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb403 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667490:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403379.667493:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.667496:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb403 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667502:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb403 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667549:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb3f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edba expref: 35 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667564:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb40a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edba expref: 34 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.667577:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403379.667579:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784403379.667582:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403379.667673:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:11556:x1871082240953472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2218us (4353us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1784403379.667683:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 195 00000100:00100000:1.0:1784403379.672117:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.672682:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240953600 00000100:00100000:3.0:1784403379.672692:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240953600 00000100:00100000:3.0:1784403379.672747:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 196 00000100:00100000:3.0:1784403379.672758:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:11556:x1871082240953600:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:3.0:1784403379.673273:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.673292:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eda5 expref: 34 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.673301:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.673337:0:6294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eda5 expref: 34 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.673855:0:6294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eda5 expref: 34 pid: 6292 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403379.674077:0:6294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260870400:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403379.674840:0:6294:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ad840 going to sleep for 11 seconds 00000100:00100000:2.0:1784403379.682366:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.682753:0:6294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260870400:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403379.682779:0:6294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403379.683183:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240953856 00000100:00100000:1.0:1784403379.683192:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240953856 00000100:00100000:1.0:1784403379.683254:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:1.0:1784403379.683265:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+35:5573:x1871082240953856:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784403379.683592:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:5573:x1871082240953856:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 327us (1233us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1784403379.683600:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:0.0:1784403379.686975:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403379.687171:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240953984 00000100:00100000:2.0:1784403379.687181:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240953984 00010000:00010000:2.0:1784403379.687225:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eda5 expref: 36 pid: 6292 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403379.687280:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00100000:2.0:1784403379.687354:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:2361:x1871082240953984:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403379.687373:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403379.687382:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eda5 expref: 36 pid: 6292 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.687400:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eda5 expref: 36 pid: 6292 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.687427:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb3bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eda5 expref: 36 pid: 6292 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.687833:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:2.0:1784403379.687840:0:6278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.687850:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.687923:0:6278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.687959:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403379.688026:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+35:2361:x1871082240953984:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 674us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403379.688033:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 73 00010000:00010000:3.0:1784403379.688675:0:6294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.688686:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.688723:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.688731:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.688739:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.688745:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40030800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.688749:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.688757:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.688770:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403379.688773:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403379.688777:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.688783:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb418 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403379.688890:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:11556:x1871082240953600:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 16103us (16753us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403379.688899:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 196 00000100:00100000:0.0:1784403379.696210:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403379.696593:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240954240 00000100:00100000:1.0:1784403379.696603:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240954240 00000100:00100000:1.0:1784403379.696667:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:1.0:1784403379.696678:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+34:11556:x1871082240954240:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403379.696971:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+35:11556:x1871082240954240:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 293us (770us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1784403379.696979:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:2.0:1784403379.801545:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403379.801760:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240954496 00000100:00100000:1.0:1784403379.801771:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240954496 00000100:00100000:1.0:1784403379.801833:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 197 00000100:00100000:1.0:1784403379.801845:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+35:11567:x1871082240954496:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:1.0:1784403379.801919:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403379.801944:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb41f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890edc1 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.802144:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb426 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.802160:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.803133:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.803156:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb42d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.803165:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb42d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.803173:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb42d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.804712:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.804734:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.804746:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403379.804763:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1784403379.804914:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.804923:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb426 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.804930:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb426 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.804937:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403379.804952:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb426 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805157:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb426 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805173:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:1.0:1784403379.805176:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403379.805191:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb426 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805198:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0400/0x6828175665afb426 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805218:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb42d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805224:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb42d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805230:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb42d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805236:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403379.805240:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb42d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805246:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb42d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805254:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a51bd0a00) 00010000:00010000:1.0:1784403379.805256:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403379.805267:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb42d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805273:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb42d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805328:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb41f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc1 expref: 38 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805344:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc1 expref: 37 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.805352:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:1.0:1784403379.805355:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403379.805357:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1000, rc 0) 00000100:00100000:1.0:1784403379.805441:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+37:11567:x1871082240954496:12345-192.168.204.28@tcp:101:cat.0 Request processed in 3598us (3908us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1784403379.805451:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 197 00000100:00100000:2.0:1784403379.826603:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403379.827842:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240954752 00000100:00100000:1.0:1784403379.827904:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240954752 00000100:00100000:1.0:1784403379.827991:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:1.0:1784403379.828003:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+37:11567:x1871082240954752:12345-192.168.204.28@tcp:35:cat.0 00000100:00100000:1.0:1784403379.828415:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+38:11567:x1871082240954752:12345-192.168.204.28@tcp:35:cat.0 Request processed in 412us (1821us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1784403379.828424:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:0.0:1784403379.865702:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.865838:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240955008 00000100:00100000:3.0:1784403379.865849:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240955008 00000100:00100000:3.0:1784403379.865949:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 198 00000100:00100000:3.0:1784403379.865967:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+38:11568:x1871082240955008:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1784403379.866028:0:10011:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784403379.866057:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1000/0x6828175665afb434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc1 expref: 38 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866090:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb40a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edba expref: 37 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866105:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb3d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edac expref: 36 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866115:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403379.866125:0:10011:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784403379.866146:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb442 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866159:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb442 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866169:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb442 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866201:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866210:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866216:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866531:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb450 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866541:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb450 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.866561:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb450 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784403379.867851:0:10011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1784403379.867898:0:10011:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385436031187ns, next at 386436027953ns, rc = 0 00010000:00010000:3.0:1784403379.868053:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868069:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868235:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868243:0:10011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868262:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868269:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868298:0:10011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403379.868321:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb450 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868327:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb450 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868333:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb450 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868338:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40030400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.868342:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb450 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868349:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb450 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868361:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245400) 00010000:00010000:3.0:1784403379.868364:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784403379.868367:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb450 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868373:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb450 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868392:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb442 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868403:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb442 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868408:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb442 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868413:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40030800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.868415:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb442 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868421:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb442 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868428:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403379.868430:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.868433:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb442 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.868438:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb442 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784403379.868448:0:10011:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000260cfc08 reply state 000000004d3d024d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403379.868456:0:10011:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784403379.868560:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+37:11568:x1871082240955008:12345-192.168.204.28@tcp:36:rm.0 Request processed in 2591us (2864us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1784403379.868569:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 198 00010000:00010000:1.0:1784403379.869562:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403379.869572:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.869604:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40031400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403379.869608:0:6280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.869616:0:6280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.869629:0:6280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c8a43245400) 00010000:00010000:1.0:1784403379.869631:0:6280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784403379.869734:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.869742:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb457 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.869765:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403379.869767:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403379.869769:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403379.870458:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.870479:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.870486:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.870491:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40031200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.870495:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.870502:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.870513:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403379.870515:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.870518:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.870524:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb449 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403379.917788:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403379.918160:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240955264 00000100:00100000:3.0:1784403379.918172:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240955264 00000100:00100000:3.0:1784403379.918233:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 199 00000100:00100000:3.0:1784403379.918244:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+36:11574:x1871082240955264:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403379.918274:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403379.918305:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb45e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890edc8 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.918473:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb465 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.918504:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb465 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.918517:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb465 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.918533:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.918541:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.918547:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784403379.920396:0:6293:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1784403379.921297:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.921316:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.921331:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.921368:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb465 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.921392:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb465 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.921399:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb465 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.921405:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40030800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.921410:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb465 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.921418:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb465 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.921432:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403379.921435:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.921440:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb465 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.921445:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb465 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784403379.921461:0:6293:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000883c8a7e reply state 00000000fe411335 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403379.921470:0:6293:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784403379.922738:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb45e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc8 expref: 39 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.922770:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc8 expref: 38 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.922799:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403379.922802:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403379.922805:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40031400, rc 0) 00000100:00100000:3.0:1784403379.923001:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+39:11574:x1871082240955264:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4757us (5223us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1784403379.923011:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 199 00000100:00100000:0.0:1784403379.945666:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403379.946206:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240955392 00000100:00100000:1.0:1784403379.946218:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240955392 00000100:00100000:1.0:1784403379.946313:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:1.0:1784403379.946325:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2358:x1871082240955392:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1784403379.946346:0:7102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403379.946367:0:7102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067d39bcf/0x6828175665afb481 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890edcf expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784403379.946395:0:7102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403379.946416:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:1.0:1784403379.946437:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403379.946447:0:7102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067d39bcf/0x6828175665afb481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edcf expref: 6 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.946468:0:7102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067d39bcf/0x6828175665afb481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edcf expref: 6 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.946482:0:7102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1c00, rc 0) 00000100:00100000:1.0:1784403379.946541:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2358:x1871082240955392:12345-192.168.204.28@tcp:101:bash.0 Request processed in 220us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403379.946548:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00080000:0.0:1784403379.947934:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784403379.949495:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.949512:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.949520:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.949526:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40030400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403379.949531:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.949539:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.949556:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403379.949559:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403379.949563:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.949569:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb46c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403379.954672:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403379.954769:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240955520 00000100:00100000:1.0:1784403379.954789:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240955520 00000100:00100000:1.0:1784403379.954850:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:1.0:1784403379.954901:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:11574:x1871082240955520:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1784403379.954922:0:7099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403379.954941:0:7099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890edd6 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.954985:0:7099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067d39bcf/0x6828175665afb481 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edcf expref: 7 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.955002:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403379.955006:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403379.955012:0:7099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 7 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.955068:0:7099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067d39bcf/0x6828175665afb481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edcf expref: 7 pid: 7102 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403379.955082:0:7099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067d39bcf/0x6828175665afb481 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edcf expref: 7 pid: 7102 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403379.955098:0:7099:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7099:1871082260870528:192.168.204.28@tcp:104: 00000100:00100000:1.0:1784403379.955189:0:7099:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403379.958283:0:7099:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7099:1871082260870528:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403379.958322:0:7099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 7 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403379.958344:0:7099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0400, rc 0) 00000100:00100000:3.0:1784403379.958421:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:11574:x1871082240955520:12345-192.168.204.28@tcp:101:bash.0 Request processed in 3552us (3758us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403379.958430:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:3.0:1784403379.960416:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403379.960515:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240955648 00000100:00100000:2.0:1784403379.960525:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240955648 00010000:00010000:2.0:1784403379.960566:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067d39bcf/0x6828175665afb481 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edcf expref: 7 pid: 7102 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403379.960610:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:2.0:1784403379.960621:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240955648:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403379.960636:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403379.960660:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067d39bcf/0x6828175665afb481 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edcf expref: 7 pid: 7102 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.960694:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067d39bcf/0x6828175665afb481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edcf expref: 7 pid: 7102 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.960720:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067d39bcf/0x6828175665afb481 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edcf expref: 7 pid: 7102 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.960737:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403379.960742:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403379.960750:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 6 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403379.960761:0:6276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 6 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403379.961666:0:6276:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 6 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403379.961686:0:6276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a730d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6276:1871082260870656:192.168.204.28@tcp:105: 00000100:00100000:0.0:1784403379.961783:0:6276:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403379.966583:0:6276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a730d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6276:1871082260870656:192.168.204.28@tcp:105: 00010000:00010000:2.0:1784403379.966609:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403379.966670:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240955648:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 6050us (6263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403379.966681:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:1.0:1784403379.969757:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403379.970007:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240955904 00000100:00100000:0.0:1784403379.970017:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240955904 00000100:00100000:0.0:1784403379.970085:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:0.0:1784403379.970096:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+38:11574:x1871082240955904:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1784403379.970654:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+39:11574:x1871082240955904:12345-192.168.204.28@tcp:35:bash.0 Request processed in 557us (905us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1784403379.970662:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00010000:00010000:0.0:1784403380.063740:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403380.142920:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.143292:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240956032 00000100:00100000:2.0:1784403380.143304:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240956032 00000100:00100000:2.0:1784403380.143548:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 200 00000100:00100000:2.0:1784403380.143560:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+39:11590:x1871082240956032:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403380.143586:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403380.143621:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb48f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eddd expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.143697:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb496 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.143711:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.143722:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403380.143781:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1784403380.143785:0:6294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403380.143809:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.143833:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb48f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eddd expref: 41 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.143944:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eddd expref: 40 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.143955:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:2.0:1784403380.143958:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784403380.143962:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2a00, rc 0) 00000100:00100000:2.0:1784403380.144033:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:11590:x1871082240956032:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 475us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.144040:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 200 00000100:00100000:3.0:1784403380.150567:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.150902:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240956288 00000100:00100000:1.0:1784403380.150913:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240956288 00000100:00100000:1.0:1784403380.150975:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 201 00000100:00100000:1.0:1784403380.150986:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+40:11590:x1871082240956288:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403380.151007:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403380.151029:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb49d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ede4 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.151144:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0000/0x6828175665afb4a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.151159:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0000/0x6828175665afb4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.151280:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0000/0x6828175665afb4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403380.151309:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1784403380.151435:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb49d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ede4 expref: 43 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.151453:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0000/0x6828175665afb4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ede4 expref: 42 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.151461:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:1.0:1784403380.151463:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403380.151467:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0000, rc 0) 00000100:00100000:1.0:1784403380.151569:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+42:11590:x1871082240956288:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 584us (1011us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1784403380.151577:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 201 00000100:00100000:1.0:1784403380.159115:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.159161:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.159715:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240956672 00000100:00100000:3.0:1784403380.159725:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240956672 00000100:00100000:3.0:1784403380.159792:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 202 00000100:00100000:3.0:1784403380.159803:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+42:11590:x1871082240956672:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403380.159827:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403380.159861:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb4b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890edeb expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.159987:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb4b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.160004:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.160016:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403380.160045:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:2.0:1784403380.160327:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240956416 00000100:00100000:2.0:1784403380.160337:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240956416 00000100:00100000:2.0:1784403380.160380:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:2.0:1784403380.160388:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+46:2360:x1871082240956416:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403380.160398:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403380.160412:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0000/0x6828175665afb4a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ede4 expref: 46 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.160427:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:2.0:1784403380.160431:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403380.160496:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+45:2360:x1871082240956416:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 109us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.160504:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00010000:00010000:3.0:1784403380.162373:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb4b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edeb expref: 45 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.162419:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb4b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edeb expref: 43 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.162428:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403380.162430:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784403380.162434:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40030400, rc 0) 00000100:00100000:2.0:1784403380.164467:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+43:11590:x1871082240956672:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4651us (5290us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1784403380.164482:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 202 00000100:00100000:1.0:1784403380.183830:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.183917:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240956800 00000100:00100000:0.0:1784403380.183927:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240956800 00000100:00100000:0.0:1784403380.184003:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:0.0:1784403380.184015:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a738dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+6:2361:x1871082240956800:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:0.0:1784403380.184321:0:7102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.184344:0:7102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 6 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.184352:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403380.184357:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784403380.184361:0:7102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.184398:0:7102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 6 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.184411:0:7102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 6 pid: 7099 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.184426:0:7102:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a730d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7102:1871082260870784:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403380.184808:0:7102:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc25840 going to sleep for 11 seconds 00000100:00100000:0.0:1784403380.194947:0:7102:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a730d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7102:1871082260870784:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403380.194981:0:7102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403380.200205:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.200954:0:7106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240956928 00000100:00100000:0.0:1784403380.200966:0:7106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240956928 00002000:00100000:0.0:1784403380.201022:0:7106:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8c8a73606d80 x1871082240956928/t0(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:151/0 lens 504/0 e 0 to 0 dl 1784403391 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784403380.201033:0:7106:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a73606d80 with x1871082240956928 ext(0->8) 00010000:00010000:0.0:1784403380.201052:0:7106:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 7 pid: 7099 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.201077:0:7106:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 7 pid: 7099 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784403380.201086:0:7106:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c8a73606d80 00000100:00100000:0.0:1784403380.201123:0:7106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:0.0:1784403380.201135:0:7106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240956928:12345-192.168.204.28@tcp:4:lfs.0 00000100:00100000:0.0:1784403380.201637:0:7106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2361:x1871082240956928:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 496us (1432us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784403380.201646:0:7106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00002000:00100000:0.0:1784403380.201653:0:7106:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8c8a73606d80 x1871082240956928/t4294967308(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:151/0 lens 504/448 e 0 to 0 dl 1784403391 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784403380.201662:0:7106:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a73606d80 with x1871082240956928 ext(0->8) 00010000:00010000:0.0:1784403380.201675:0:7106:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 9 pid: 7099 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.201688:0:7106:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 9 pid: 7099 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784403380.201696:0:7106:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c8a73606d80 00000100:00100000:3.0:1784403380.204951:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.205109:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240957056 00000100:00100000:2.0:1784403380.205119:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240957056 00010000:00010000:2.0:1784403380.205161:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 9 pid: 7099 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403380.205221:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:2.0:1784403380.205231:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2360:x1871082240957056:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403380.205248:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784403380.205267:0:6276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784403380.205270:0:6276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784403380 00002000:00010000:2.0:1784403380.205272:0:6276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784403380 00002000:00010000:2.0:1784403380.205288:0:6276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1784403380 00010000:00010000:2.0:1784403380.205295:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 9 pid: 7099 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.205311:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 9 pid: 7099 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.205337:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb488 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edd6 expref: 9 pid: 7099 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.205353:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784403380.205358:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784403380.205364:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.205373:0:6276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.205397:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403380.205457:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240957056:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 227us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.205464:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 75 00010000:00010000:0.0:1784403380.206221:0:7102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.206236:0:7102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.206267:0:7102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.206276:0:7102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.206284:0:7102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.206292:0:7102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4200 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403380.206297:0:7102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.206306:0:7102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.206331:0:7102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.206338:0:7102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b4c15e/0x6828175665afb4c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.206404:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a738dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240956800:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 22392us (22584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.206412:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:3.0:1784403380.208744:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.209755:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240957312 00000100:00100000:2.0:1784403380.209767:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240957312 00000100:00100000:2.0:1784403380.209909:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:2.0:1784403380.209920:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+43:11590:x1871082240957312:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:2.0:1784403380.209983:0:6295:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb4b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edeb expref: 43 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784403380.210260:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1784403380.210304:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1784403380.210623:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1784403380.210676:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.210691:0:6295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc8 expref: 47 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.210699:0:6295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.210732:0:6295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc8 expref: 47 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.210746:0:6295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc8 expref: 47 pid: 6293 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403380.210758:0:6295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6295:1871082260870912:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403380.210846:0:6295:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1784403380.215300:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.215389:0:6295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6295:1871082260870912:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403380.215419:0:6295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403380.215788:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240957440 00000100:00100000:3.0:1784403380.215796:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240957440 00010000:00010000:3.0:1784403380.215834:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc8 expref: 48 pid: 6293 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403380.215906:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:3.0:1784403380.215916:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+48:2361:x1871082240957440:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403380.215931:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403380.215939:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc8 expref: 48 pid: 6293 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.215951:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc8 expref: 48 pid: 6293 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.215992:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb473 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edc8 expref: 48 pid: 6293 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.216009:0:6277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:3.0:1784403380.216014:0:6277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.216024:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.216031:0:6277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.216067:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403380.216118:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+47:2361:x1871082240957440:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 203us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403380.216126:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 76 00010000:00010000:0.0:1784403380.216314:0:6295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.216322:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784403380.216445:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1784403380.216655:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1784403380.216759:0:6295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a730d4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260871040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784403380.216809:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403380.216836:0:6295:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc25600 going to sleep for 11 seconds 00000100:00100000:2.0:1784403380.218724:0:6298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260871040 00000100:00100000:2.0:1784403380.218739:0:6298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260871040 00000100:00100000:2.0:1784403380.218826:0:6298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1784403380.218891:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784403380.218936:0:6298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6295:x1871082260871040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784403380.220193:0:6298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6295:x1871082260871040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1256us (3378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.222163:0:6295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a730d4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260871040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784403380.222938:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1784403380.223028:0:6295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73605500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260871168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784403380.223105:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403380.223140:0:6295:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1540 going to sleep for 11 seconds 00000100:00100000:3.0:1784403380.223159:0:6297:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1784403380.223170:0:6297:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1784403380.223536:0:6298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784403380.223562:0:6298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260871168 00000100:00100000:2.0:1784403380.223568:0:6298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260871168 00000100:00100000:2.0:1784403380.223605:0:6298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784403380.223615:0:6298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6295:x1871082260871168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784403380.223796:0:6298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6295:x1871082260871168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 182us (690us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784403380.223802:0:6298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784403380.224023:0:6295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73605500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6295:1871082260871168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784403380.224095:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1784403380.224136:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.224158:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.224165:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.224184:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403380.224188:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.224196:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.224212:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:1.0:1784403380.224215:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784403380.224220:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.224227:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb4ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784403380.224401:0:6295:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784403380.224499:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1784403380.224511:0:6295:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385792644781ns, next at 386792642406ns, rc = 0 00000001:00080000:1.0:1784403380.224518:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1784403380.224546:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245d00) 00010000:00010000:1.0:1784403380.224549:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784403380.224556:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb4b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edeb expref: 51 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403380.224861:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+50:11590:x1871082240957312:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 14941us (16124us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1784403380.224909:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 56 00000020:00080000:1.0:1784403380.224913:0:6295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784403380.232948:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.233146:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240957568 00000100:00100000:3.0:1784403380.233156:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240957568 00000100:00100000:3.0:1784403380.233335:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 203 00000100:00100000:3.0:1784403380.233347:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+50:11590:x1871082240957568:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403380.233371:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403380.233393:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb4d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890edf2 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.233451:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb4d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf2 expref: 51 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.233480:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb4d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf2 expref: 51 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.233501:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403380.233504:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403380.233508:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40030800, rc 0) 00000100:00100000:3.0:1784403380.233571:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:11590:x1871082240957568:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 226us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403380.233579:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 203 00000100:00100000:3.0:1784403380.241424:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.241583:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240957824 00000100:00100000:1.0:1784403380.241593:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240957824 00000100:00100000:1.0:1784403380.241665:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:1.0:1784403380.241676:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+51:11590:x1871082240957824:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403380.241956:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:11590:x1871082240957824:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 281us (543us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1784403380.241965:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:0.0:1784403380.326019:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.326606:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240957952 00000100:00100000:2.0:1784403380.326618:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240957952 00000100:00100000:2.0:1784403380.326688:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 204 00000100:00100000:2.0:1784403380.326700:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:11600:x1871082240957952:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:2.0:1784403380.327290:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb4dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327309:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb4dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327322:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb4dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327339:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb4e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327413:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327420:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327540:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327550:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327558:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403380.327604:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327618:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb4dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327739:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb4dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327748:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb4dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327755:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403380.327759:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb4dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327767:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb4dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327843:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:2.0:1784403380.327856:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403380.327861:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb4dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327897:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb4dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327911:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327917:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb4e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327922:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327928:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403380.327931:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327937:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327945:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a429d0200) 00010000:00010000:2.0:1784403380.327948:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403380.327950:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb4e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.327956:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb4e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.328156:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.328161:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.328173:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.328179:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403380.328182:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.328188:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.328195:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:2.0:1784403380.328197:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403380.328200:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.328205:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb4ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403380.328301:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:11600:x1871082240957952:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 1601us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.328310:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 204 00000100:00100000:3.0:1784403380.379740:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.380003:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240958208 00000100:00100000:1.0:1784403380.380013:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240958208 00000100:00100000:1.0:1784403380.380080:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 205 00000100:00100000:1.0:1784403380.380092:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+52:11603:x1871082240958208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403380.380128:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403380.380153:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb4f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890edf9 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380232:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb4f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380247:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380261:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380293:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb4ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380301:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380309:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380447:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380457:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380465:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403380.380475:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1784403380.380575:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380584:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb4f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380591:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380598:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403380.380602:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380620:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb4f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380645:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:1.0:1784403380.380648:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403380.380653:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb4f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380659:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1c00/0x6828175665afb4f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380676:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380681:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb4ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380687:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb4ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380692:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:1.0:1784403380.380694:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb4ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380700:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb4ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380706:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a51bd0f00) 00010000:00010000:1.0:1784403380.380709:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784403380.380711:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb4ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380726:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb4ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380771:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb4f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf9 expref: 55 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380786:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf9 expref: 54 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.380793:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:1.0:1784403380.380796:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784403380.380799:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0e00, rc 0) 00000100:00100000:1.0:1784403380.380953:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:11603:x1871082240958208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 862us (1222us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1784403380.380962:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 205 00000100:00100000:3.0:1784403380.385980:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.386601:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240958336 00000100:00100000:0.0:1784403380.386612:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240958336 00000100:00100000:0.0:1784403380.386689:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 206 00000100:00100000:0.0:1784403380.386700:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:11603:x1871082240958336:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:0.0:1784403380.386776:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb514 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.386794:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.386807:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.386838:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.386854:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb514 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.386863:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.386885:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403380.386890:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.386897:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb514 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.386908:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:0.0:1784403380.386923:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784403380.386929:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb514 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.386935:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb514 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.387011:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:11603:x1871082240958336:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 312us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.387020:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 206 00000100:00100000:0.0:1784403380.390405:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.390487:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240958592 00000100:00100000:1.0:1784403380.390496:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240958592 00000100:00100000:1.0:1784403380.390553:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:1.0:1784403380.390562:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+54:11603:x1871082240958592:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403380.390815:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:11603:x1871082240958592:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 254us (420us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1784403380.390823:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:0.0:1784403380.448733:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784403380.448825:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260871424:0@lo:400:kworker.0 00000100:00100000:1.0:1784403380.448835:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260871552:0@lo:400:kworker.0 00000100:00100000:3.0:1784403380.448935:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403380.448984:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260871424 00000100:00100000:1.0:1784403380.448992:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260871424 00000100:00100000:3.0:1784403380.449014:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403380.449022:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260871680:0@lo:400:kworker.0 00000100:00100000:0.0:1784403380.449054:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403380.449068:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260871552 00000100:00100000:1.0:1784403380.449073:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260871552 00000100:00100000:0.0:1784403380.449078:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260871296:0@lo:400:kworker.0 00000100:00100000:0.0:1784403380.449110:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403380.449144:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260871680 00000100:00100000:0.0:1784403380.449149:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260871680 00000100:00100000:0.0:1784403380.449183:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784403380.449194:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260871680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403380.449245:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260871680:12345-0@lo:400:kworker.0 Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.449252:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784403380.449276:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260871296 00000100:00100000:0.0:1784403380.449279:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260871296 00000100:00100000:3.0:1784403380.449285:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784403380.449300:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1784403380.449307:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260871296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403380.449336:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260871296:12345-0@lo:400:kworker.0 Request processed in 30us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.449349:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:0.0:1784403380.449395:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784403380.449400:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403380.449431:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260871680:0@lo:400:kworker.0 00000100:00100000:0.0:1784403380.449442:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260871296:0@lo:400:kworker.0 00000100:00100000:2.0:1784403380.449670:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260871808:0@lo:400:kworker.0 00000100:00100000:2.0:1784403380.449704:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403380.450729:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784403380.450742:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260871936:0@lo:400:kworker.0 00000100:00100000:2.0:1784403380.450779:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403380.450807:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260871936 00000100:00100000:2.0:1784403380.450813:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260871936 00000100:00100000:2.0:1784403380.450877:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784403380.450896:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3568:x1871082260871936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403380.450941:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3568:x1871082260871936:12345-0@lo:400:kworker.0 Request processed in 47us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.450948:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784403380.450981:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260871936:0@lo:400:kworker.0 00000100:00100000:2.0:1784403380.451042:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260871424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403380.451080:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260871424:12345-0@lo:400:kworker.0 Request processed in 1789us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.451088:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784403380.451936:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260871808 00000100:00100000:1.0:1784403380.451946:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260871808 00000100:00100000:0.0:1784403380.451972:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784403380.451986:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260871552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403380.452011:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784403380.452023:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260871808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403380.452046:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260871552:12345-0@lo:400:kworker.0 Request processed in 65us (3032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.452053:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784403380.452085:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260871552:0@lo:400:kworker.0 00000100:00080000:0.0:1784403380.452121:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403380.452246:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260871424:0@lo:400:kworker.0 00000100:00100000:1.0:1784403380.452540:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260871808:12345-0@lo:400:kworker.0 Request processed in 518us (2832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403380.452547:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784403380.452630:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260871808:0@lo:400:kworker.0 00000100:00100000:3.0:1784403380.487554:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.491153:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240958848 00000100:00100000:0.0:1784403380.491169:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240958848 00000100:00100000:0.0:1784403380.491324:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 207 00000100:00100000:0.0:1784403380.491336:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:11613:x1871082240958848:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1784403380.491363:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403380.491367:0:10011:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784403380.491397:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eddd expref: 55 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.491416:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:0.0:1784403380.491421:0:10011:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403380.491435:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb51b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee00 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.491572:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.491588:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf9 expref: 55 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.491606:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.491640:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf9 expref: 55 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.491655:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf9 expref: 55 pid: 6292 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.491670:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a730d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260872064:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403380.491769:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc25780 going to sleep for 11 seconds 00000100:00100000:3.0:1784403380.495591:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.495720:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a730d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260872064:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403380.495748:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403380.496413:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240958976 00000100:00100000:1.0:1784403380.496421:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240958976 00010000:00010000:1.0:1784403380.496461:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf9 expref: 56 pid: 6292 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403380.496755:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:1.0:1784403380.496766:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+56:2360:x1871082240958976:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403380.496782:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403380.496790:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf9 expref: 56 pid: 6292 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.496802:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf9 expref: 56 pid: 6292 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.496825:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb506 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf9 expref: 56 pid: 6292 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.496842:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:1.0:1784403380.497197:0:6278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.497221:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.497229:0:6278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.497297:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403380.497358:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:2360:x1871082240958976:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 594us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403380.497367:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 77 00010000:00010000:0.0:1784403380.502191:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.502214:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403380.502240:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1784403380.502430:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5000/0x6828175665afb51b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee00 expref: 56 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.502454:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee00 expref: 55 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.502462:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:0.0:1784403380.502465:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784403380.502468:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5400, rc 0) 00000100:00100000:0.0:1784403380.502544:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:11613:x1871082240958848:12345-192.168.204.28@tcp:101:bash.0 Request processed in 11210us (14999us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1784403380.502553:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 207 00000100:00100000:3.0:1784403380.507013:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.507085:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240959232 00000100:00100000:1.0:1784403380.507095:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240959232 00000100:00100000:1.0:1784403380.507162:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 208 00000100:00100000:1.0:1784403380.507172:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+55:11613:x1871082240959232:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1784403380.507470:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.507486:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.507498:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403380.507558:0:6292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1784403380.507581:0:6292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000505d1db2 reply state 000000006cdeeb92 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403380.507590:0:6292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784403380.507681:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:11613:x1871082240959232:12345-192.168.204.28@tcp:36:bash.0 Request processed in 510us (679us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1784403380.507704:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 208 00000020:00080000:1.0:1784403380.507709:0:6292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784403380.514154:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.514173:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.514181:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.514188:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403380.514194:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.514203:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.514220:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:2.0:1784403380.514238:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403380.514243:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.514251:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afb530 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403380.517446:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.518100:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240959360 00000100:00100000:2.0:1784403380.518113:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240959360 00000100:00100000:2.0:1784403380.518167:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 209 00000100:00100000:2.0:1784403380.518177:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:11613:x1871082240959360:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1784403380.518203:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403380.518225:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb537 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee07 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.518335:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.518354:0:6293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee00 expref: 58 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.518363:0:6293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.518402:0:6293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee00 expref: 58 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.518417:0:6293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee00 expref: 58 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403380.518448:0:6293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260872192:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403380.518567:0:6293:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403380.521175:0:6293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260872192:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403380.521208:0:6293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403380.521439:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.525106:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240959488 00000100:00100000:0.0:1784403380.525120:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240959488 00010000:00010000:1.0:1784403380.526072:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee00 expref: 59 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403380.529315:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:1.0:1784403380.529341:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:2360:x1871082240959488:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403380.529363:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403380.529375:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee00 expref: 59 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.529392:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee00 expref: 59 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.529416:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5400/0x6828175665afb522 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee00 expref: 59 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.529435:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:1.0:1784403380.529440:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.529450:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.529457:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.529497:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403380.529570:0:6293:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.529581:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403380.529634:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784403380.529638:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403380.529658:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.529688:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb537 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee07 expref: 59 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.529703:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee07 expref: 58 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.529710:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:2.0:1784403380.529713:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784403380.529715:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2800, rc 0) 00000100:00100000:2.0:1784403380.529771:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:11613:x1871082240959360:12345-192.168.204.28@tcp:101:bash.0 Request processed in 11595us (12337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.529785:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 209 00000100:00100000:1.0:1784403380.536005:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:2360:x1871082240959488:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 6664us (14555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403380.536020:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:3.0:1784403380.541148:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.541271:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240959744 00000100:00100000:1.0:1784403380.541283:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240959744 00000100:00100000:1.0:1784403380.541349:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:1.0:1784403380.541360:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+57:11613:x1871082240959744:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1784403380.541605:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:11613:x1871082240959744:12345-192.168.204.28@tcp:35:bash.0 Request processed in 246us (468us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1784403380.541612:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:0.0:1784403380.653835:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.655008:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240959872 00000100:00100000:1.0:1784403380.655022:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240959872 00000100:00100000:1.0:1784403380.655215:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 210 00000100:00100000:1.0:1784403380.655228:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+58:11619:x1871082240959872:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1784403380.655254:0:6292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403380.655294:0:6292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb545 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee0e expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.655364:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb54c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.655380:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb54c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.655392:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb54c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403380.655451:0:6292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1784403380.655467:0:6292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403380.655496:0:6292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb54c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.655541:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0e00/0x6828175665afb545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee0e expref: 60 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.655559:0:6292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb54c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee0e expref: 59 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.655577:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:1.0:1784403380.655580:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784403380.655584:0:6292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1a00, rc 0) 00000100:00100000:1.0:1784403380.655665:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11619:x1871082240959872:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 440us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403380.655673:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 210 00000100:00100000:0.0:1784403380.664485:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.664709:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240960000 00000100:00100000:2.0:1784403380.664719:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240960000 00000100:00100000:2.0:1784403380.664826:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 211 00000100:00100000:2.0:1784403380.664850:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11619:x1871082240960000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403380.664900:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403380.664924:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb553 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee15 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.664994:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb55a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665010:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb55a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665021:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb55a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665036:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665057:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665066:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665168:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665194:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665202:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403380.665237:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784403380.665241:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403380.665260:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665279:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665298:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb55a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665305:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb55a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665311:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb55a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665317:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403380.665320:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb55a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665327:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb55a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665338:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:2.0:1784403380.665347:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403380.665354:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb55a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665361:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb55a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665377:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665383:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb561 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665390:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb561 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665395:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403380.665397:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb561 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665404:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb561 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665412:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a429d0200) 00010000:00010000:2.0:1784403380.665415:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403380.665418:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb561 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665424:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2600/0x6828175665afb561 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665456:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb553 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee15 expref: 61 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665483:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee15 expref: 60 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.665491:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:2.0:1784403380.665493:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784403380.665495:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3200, rc 0) 00000100:00100000:2.0:1784403380.665580:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11619:x1871082240960000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 743us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.665588:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 211 00000100:00100000:0.0:1784403380.670956:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.671027:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240960256 00000100:00100000:2.0:1784403380.671037:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240960256 00000100:00100000:2.0:1784403380.671107:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 212 00000100:00100000:2.0:1784403380.671118:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11619:x1871082240960256:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403380.671144:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403380.671167:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb56f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee1c expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.671267:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.671295:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee07 expref: 61 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.671305:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee15 expref: 61 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.671332:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.671368:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee15 expref: 61 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.671381:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee15 expref: 61 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403380.671394:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260872320:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403380.671488:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee07 expref: 61 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.671497:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee07 expref: 61 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403380.671506:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260872448:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403380.671703:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403380.681434:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.681695:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240960384 00000100:00100000:1.0:1784403380.681705:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240960384 00010000:00010000:1.0:1784403380.681748:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee15 expref: 62 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403380.681962:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:1.0:1784403380.681974:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+62:2360:x1871082240960384:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403380.681993:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403380.682000:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee15 expref: 62 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.682013:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee15 expref: 62 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.682065:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:1.0:1784403380.682070:0:6278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.682080:0:6278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.682086:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403380.682137:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+62:2360:x1871082240960384:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 165us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403380.682145:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 79 00010000:00010000:2.0:1784403380.684212:0:10011:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@00000000fc184cd7 x1871082260872320) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee15 expref: 61 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.684236:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb568 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee15 expref: 61 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403380.684254:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260872320:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403380.684299:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260872448:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403380.684328:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:2.0:1784403380.684333:0:10011:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.684341:0:10011:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.684350:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.688236:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.692056:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240960512 00000100:00100000:1.0:1784403380.692072:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240960512 00010000:00010000:0.0:1784403380.692459:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee07 expref: 61 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.692610:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:0.0:1784403380.692621:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:2361:x1871082240960512:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403380.692637:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403380.692644:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee07 expref: 61 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.692676:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee07 expref: 61 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.692698:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afb53e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee07 expref: 61 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.692716:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:0.0:1784403380.692721:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.692731:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.692738:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.692772:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403380.692859:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:2361:x1871082240960512:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 220us (4613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.692891:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 80 00010000:00010000:2.0:1784403380.692957:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.692969:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403380.692990:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784403380.693142:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb56f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee1c expref: 61 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.693159:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee1c expref: 60 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.693167:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:2.0:1784403380.693170:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784403380.693173:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2400, rc 0) 00000100:00100000:2.0:1784403380.693220:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11619:x1871082240960256:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 22103us (22274us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1784403380.693238:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 212 00000100:00100000:0.0:1784403380.699885:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403380.700002:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240960768 00000100:00100000:1.0:1784403380.700013:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240960768 00000100:00100000:1.0:1784403380.700075:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:1.0:1784403380.700086:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11619:x1871082240960768:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:1.0:1784403380.700103:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403380.700129:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb4d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edf2 expref: 60 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403380.700149:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:1.0:1784403380.700154:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403380.700219:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11619:x1871082240960768:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 135us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403380.700227:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:1.0:1784403380.702397:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.702483:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240960896 00000100:00100000:3.0:1784403380.702492:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240960896 00000100:00100000:3.0:1784403380.702554:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 213 00000100:00100000:3.0:1784403380.702564:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11619:x1871082240960896:12345-192.168.204.28@tcp:58:lfs.0 00010000:00010000:3.0:1784403380.702692:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.702708:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.702719:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784403380.702969:0:6293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1784403380.703049:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11619:x1871082240960896:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 486us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403380.703057:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 213 00000100:00100000:0.0:1784403380.705254:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.705340:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240961024 00000100:00100000:3.0:1784403380.705350:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240961024 00000100:00100000:3.0:1784403380.705452:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 214 00000100:00100000:3.0:1784403380.705463:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+59:11619:x1871082240961024:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403380.705484:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403380.705504:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb58b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee23 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.705581:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.705592:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb58b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee23 expref: 60 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.705612:0:6294:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.705655:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb58b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee23 expref: 60 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.705668:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403380.705671:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403380.705675:0:6294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb58b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee23 expref: 60 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.705682:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40031200, rc 0) 00000100:00100000:3.0:1784403380.705739:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11619:x1871082240961024:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 277us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403380.705746:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 214 00000040:00080000:2.0:1784403380.831515:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784403380.831524:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784403380.831559:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1784403380.831564:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784403380.831714:0:12049:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260872576:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784403380.832756:0:12049:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce240 going to sleep for 11 seconds 00000100:00100000:0.0:1784403380.836461:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.836567:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240961152 00000100:00100000:3.0:1784403380.836576:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240961152 00000100:00100000:3.0:1784403380.836635:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 215 00000100:00100000:3.0:1784403380.836644:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:11620:x1871082240961152:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784403380.836676:0:6293:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784403380.836772:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:11620:x1871082240961152:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 127us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403380.836779:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 215 00000100:00100000:2.0:1784403380.837168:0:12049:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260872576:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784403380.842339:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.844969:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240961280 00000100:00100000:2.0:1784403380.844986:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240961280 00000100:00100000:2.0:1784403380.845061:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 216 00000100:00100000:2.0:1784403380.845071:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11620:x1871082240961280:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784403380.845148:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb592 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845165:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb592 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845178:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb592 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845193:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb599 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845201:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb599 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845208:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb599 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845249:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845258:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845265:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403380.845302:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784403380.845307:0:10011:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403380.845320:0:10011:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845332:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb592 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845338:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb592 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845346:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb592 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845352:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403380.845356:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb592 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845363:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb592 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845374:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:2.0:1784403380.845385:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403380.845390:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb592 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845396:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afb592 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845411:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb599 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845416:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb599 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845422:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb599 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845428:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403380.845430:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb599 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845437:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb599 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845444:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8c8a429d0200) 00010000:00010000:2.0:1784403380.845446:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403380.845449:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb599 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845454:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb599 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845469:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845481:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845487:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845492:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403380.845495:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845500:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845508:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:2.0:1784403380.845510:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403380.845512:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.845517:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403380.845607:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11620:x1871082240961280:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 Request processed in 537us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.845616:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 216 00000100:00100000:1.0:1784403380.848140:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.848606:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240961536 00000100:00100000:3.0:1784403380.848616:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240961536 00000100:00100000:3.0:1784403380.848673:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 217 00000100:00100000:3.0:1784403380.848684:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+60:11620:x1871082240961536:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403380.848704:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403380.848739:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb5a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee2a expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.848850:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.848893:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.848906:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403380.848917:0:6293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784403380.849017:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.849025:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.849032:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.849038:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40030400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403380.849042:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.849050:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.849063:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403380.849067:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784403380.849071:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.849088:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.849131:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb5a7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee2a expref: 62 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.849141:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:3.0:1784403380.849143:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403380.849146:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb5a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee2a expref: 62 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.849156:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40030800, rc 0) 00000100:00100000:3.0:1784403380.849220:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:11620:x1871082240961536:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 538us (1090us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1784403380.849227:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 217 00000100:00100000:3.0:1784403380.860066:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.860398:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240961664 00000100:00100000:2.0:1784403380.860409:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240961664 00000100:00100000:2.0:1784403380.860471:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 218 00000100:00100000:2.0:1784403380.860483:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:11620:x1871082240961664:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784403380.860518:0:10011:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784403380.860628:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:11620:x1871082240961664:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 147us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.860637:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 218 00000100:00100000:1.0:1784403380.863450:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.863522:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240961920 00000100:00100000:3.0:1784403380.863530:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240961920 00000100:00100000:3.0:1784403380.863581:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 219 00000100:00100000:3.0:1784403380.863589:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:11620:x1871082240961920:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403380.863608:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403380.863610:0:6293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784403380.863637:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1a00/0x6828175665afb54c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee0e expref: 61 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.863658:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:3.0:1784403380.863676:0:6293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784403380.863692:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb5bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee31 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784403380.864149:0:6293:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1784403380.864359:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.864375:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.864387:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.864444:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb5bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee31 expref: 63 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.864459:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee31 expref: 62 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.864468:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245b00) 00010000:00010000:3.0:1784403380.864471:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403380.864473:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40030400, rc 0) 00000100:00100000:3.0:1784403380.864528:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+62:11620:x1871082240961920:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 940us (1086us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1784403380.864535:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 219 00000100:00100000:0.0:1784403380.868496:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.868593:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240962176 00000100:00100000:2.0:1784403380.868604:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240962176 00000100:00100000:2.0:1784403380.868679:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 220 00000100:00100000:2.0:1784403380.868690:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+62:11620:x1871082240962176:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784403380.868750:0:10011:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403380.868777:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee31 expref: 62 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.868798:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245b00) 00010000:00010000:2.0:1784403380.868807:0:10011:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403380.868830:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.868855:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.868905:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.868940:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb5d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc88949c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.868948:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb5d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88949c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.868955:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb5d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88949c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869434:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869444:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869457:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869463:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403380.869467:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869474:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869485:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:0.0:1784403380.869487:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403380.869490:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869496:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afb5d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869506:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb5d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88949c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869511:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb5d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88949c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869516:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb5d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88949c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869520:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403380.869523:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb5d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88949c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869538:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb5d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88949c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869545:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc88949c5 (ffff8c8a429d0200) 00010000:00010000:0.0:1784403380.869548:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403380.869551:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb5d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc88949c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.869557:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb5d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc88949c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.869639:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:11620:x1871082240962176:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 949us (1152us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784403380.869648:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 220 00000100:00100000:1.0:1784403380.882608:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.882750:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240962304 00000100:00100000:3.0:1784403380.882760:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240962304 00000100:00100000:3.0:1784403380.882821:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 221 00000100:00100000:3.0:1784403380.882830:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+61:11620:x1871082240962304:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403380.882913:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403380.882938:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb5df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee38 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.882977:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.882990:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.883000:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.883110:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030800/0x6828175665afb5df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee38 expref: 63 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.883130:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee38 expref: 62 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.883138:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:3.0:1784403380.883140:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784403380.883144:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a40030400, rc 0) 00000100:00100000:3.0:1784403380.883197:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+62:11620:x1871082240962304:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 367us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403380.883204:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 221 00000100:00100000:3.0:1784403380.885443:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.885745:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240962560 00000100:00100000:0.0:1784403380.885757:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240962560 00000100:00100000:0.0:1784403380.885821:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 222 00000100:00100000:0.0:1784403380.885832:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+62:11620:x1871082240962560:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784403380.885950:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.885967:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.885980:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784403380.886249:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1784403380.886260:0:6294:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386454393207ns, next at 387454390162ns, rc = 0 00000004:00010000:0.0:1784403380.886371:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de06dea8 reply state 0000000018f45430 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.886382:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784403380.886484:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+64:11620:x1871082240962560:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 652us (1051us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1784403380.886492:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 222 00000100:00100000:1.0:1784403380.889646:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1784403380.890089:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.890102:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.890110:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.890118:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403380.890123:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.890130:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.890149:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:2.0:1784403380.890153:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784403380.890158:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.890164:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb5ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403380.890342:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240962688 00000100:00100000:3.0:1784403380.890354:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240962688 00000100:00100000:3.0:1784403380.890407:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 223 00000100:00100000:3.0:1784403380.890431:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a48973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+63:11620:x1871082240962688:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403380.890455:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403380.890473:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb5f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee3f expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.890530:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee3f expref: 64 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.890543:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee3f expref: 64 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.890560:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:3.0:1784403380.890563:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403380.890566:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:3.0:1784403380.890643:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a48973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+64:11620:x1871082240962688:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 214us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403380.890651:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 223 00000100:00100000:3.0:1784403380.893595:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.893834:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240962816 00000100:00100000:0.0:1784403380.893858:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240962816 00000100:00100000:0.0:1784403380.893962:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:0.0:1784403380.893975:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2361:x1871082240962816:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784403380.894287:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:2361:x1871082240962816:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 314us (700us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1784403380.894295:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:1.0:1784403380.898627:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.898753:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240963072 00000100:00100000:3.0:1784403380.898763:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240963072 00000100:00100000:3.0:1784403380.898823:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:3.0:1784403380.898843:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+64:11620:x1871082240963072:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784403380.900286:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+65:11620:x1871082240963072:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 1446us (1670us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1784403380.900297:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:1.0:1784403380.905307:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.909034:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240963328 00000100:00100000:0.0:1784403380.909049:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240963328 00000100:00100000:0.0:1784403380.909184:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 224 00000100:00100000:0.0:1784403380.909196:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4302d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+65:11620:x1871082240963328:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784403380.909331:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4302d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+65:11620:x1871082240963328:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 136us (4032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.909339:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 224 00000100:00100000:1.0:1784403380.912506:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.912584:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240963456 00000100:00100000:3.0:1784403380.912609:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240963456 00000100:00100000:3.0:1784403380.912676:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 225 00000100:00100000:3.0:1784403380.912686:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+65:11620:x1871082240963456:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403380.912708:0:6293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403380.912729:0:6293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb5fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee46 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.912812:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb602 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.912827:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.912850:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403380.912921:0:6293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403380.912941:0:6293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.912967:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb5fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee46 expref: 67 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.912986:0:6293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb602 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee46 expref: 66 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.912994:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:3.0:1784403380.912997:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784403380.913001:0:6293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6600, rc 0) 00000100:00100000:3.0:1784403380.913069:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+66:11620:x1871082240963456:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 376us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403380.913084:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 225 00000100:00100000:1.0:1784403380.915843:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.916358:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240963584 00000100:00100000:2.0:1784403380.916370:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240963584 00000100:00100000:2.0:1784403380.916434:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:2.0:1784403380.916447:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+10:2360:x1871082240963584:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784403380.916467:0:8571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403380.916500:0:8571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e59feb54/0x6828175665afb609 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee4d expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784403380.916535:0:8571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bd5b5, blocks: 0x1 00010000:00010000:2.0:1784403380.916554:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1784403380.916559:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403380.916582:0:8571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e59feb54/0x6828175665afb609 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee4d expref: 11 pid: 8571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.916601:0:8571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e59feb54/0x6828175665afb609 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee4d expref: 11 pid: 8571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.916615:0:8571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2a00, rc 0) 00000100:00100000:2.0:1784403380.916797:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:2360:x1871082240963584:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 353us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.916805:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:1.0:1784403380.920184:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.920277:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240963840 00000100:00100000:2.0:1784403380.920355:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240963840 00000100:00100000:2.0:1784403380.920456:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 226 00000100:00100000:2.0:1784403380.920467:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+66:11620:x1871082240963840:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784403380.920596:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+66:11620:x1871082240963840:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 130us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403380.920605:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 226 00000100:00100000:1.0:1784403380.922907:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.922982:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240963968 00000100:00100000:0.0:1784403380.922991:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240963968 00000100:00100000:0.0:1784403380.923089:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:0.0:1784403380.923101:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:11620:x1871082240963968:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784403380.923117:0:7101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403380.923149:0:7101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee54 expref: -99 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.923188:0:7101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e59feb54/0x6828175665afb609 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee4d expref: 12 pid: 8571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.923198:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403380.923203:0:7101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403380.923208:0:7101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 12 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.923242:0:7101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e59feb54/0x6828175665afb609 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee4d expref: 12 pid: 8571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.923258:0:7101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e59feb54/0x6828175665afb609 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee4d expref: 12 pid: 8571 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.923272:0:7101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a730d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7101:1871082260872704:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403380.923367:0:7101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403380.928135:0:7101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a730d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7101:1871082260872704:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403380.928176:0:7101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 12 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.928197:0:7101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4200, rc 0) 00000100:00100000:0.0:1784403380.928258:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:11620:x1871082240963968:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 5159us (5362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.928334:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:1.0:1784403380.933280:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.933418:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240964096 00000100:00100000:0.0:1784403380.933429:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240964096 00010000:00010000:0.0:1784403380.933473:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e59feb54/0x6828175665afb609 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee4d expref: 12 pid: 8571 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.933529:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:0.0:1784403380.933539:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+12:2361:x1871082240964096:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403380.933558:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403380.933591:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e59feb54/0x6828175665afb609 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee4d expref: 12 pid: 8571 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.933606:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e59feb54/0x6828175665afb609 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee4d expref: 12 pid: 8571 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.934064:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e59feb54/0x6828175665afb609 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee4d expref: 12 pid: 8571 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.934083:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403380.934087:0:6276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403380.934100:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 11 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.934111:0:6276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 11 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.934175:0:6276:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 11 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.934189:0:6276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a730d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6276:1871082260872832:192.168.204.28@tcp:105: 00000100:00100000:0.0:1784403380.935715:0:6276:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403380.939346:0:6276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a730d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6276:1871082260872832:192.168.204.28@tcp:105: 00010000:00010000:0.0:1784403380.939376:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403380.939436:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:2361:x1871082240964096:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 5897us (6164us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.939447:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:0.0:1784403380.941117:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403380.941379:0:7105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240964224 00000100:00100000:3.0:1784403380.941389:0:7105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240964224 00002000:00100000:3.0:1784403380.942741:0:7105:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8c8a730d4000 x1871082240964224/t0(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:151/0 lens 504/0 e 0 to 0 dl 1784403391 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784403380.942756:0:7105:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a730d4000 with x1871082240964224 ext(0->12) 00002000:00010000:3.0:1784403380.942764:0:7105:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a730d4000 00000100:00100000:2.0:1784403380.942858:0:7107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:2.0:1784403380.942908:0:7107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+11:2360:x1871082240964224:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784403380.943369:0:7107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:2360:x1871082240964224:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 Request processed in 471us (2260us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1784403380.943378:0:7107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00002000:00100000:2.0:1784403380.943385:0:7107:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8c8a730d4000 x1871082240964224/t4294967320(0) o4->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:151/0 lens 504/448 e 0 to 0 dl 1784403391 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784403380.943393:0:7107:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a730d4000 with x1871082240964224 ext(0->12) 00002000:00010000:2.0:1784403380.943397:0:7107:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a730d4000 00000100:00100000:1.0:1784403380.947090:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403380.947230:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240964352 00000100:00100000:0.0:1784403380.947241:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240964352 00000100:00100000:0.0:1784403380.947303:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 227 00000100:00100000:0.0:1784403380.947313:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+66:11620:x1871082240964352:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1784403380.960329:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403380.960520:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260872960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403380.961222:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403380.961391:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260872960 00000100:00100000:1.0:1784403380.961401:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260872960 00000100:00100000:1.0:1784403380.961450:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784403380.961460:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260872960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784403380.961486:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403380.961536:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260872960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403380.961543:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784403380.961810:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260872960:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1784403380.979364:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1784403380.979378:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1784403380.979429:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1784403380.979449:0:6314:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c8a65fb1e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1784403380.979454:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a5023ce00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a65fb1180 00000020:00080000:2.0:1784403380.979457:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a5023c700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a4551d000 00000001:00080000:2.0:1784403380.979513:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1784403380.979534:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1784403380.979555:0:6314:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c8a45350b40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1784403380.979558:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a42c01100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a45350540 00000020:00080000:2.0:1784403380.979561:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a42c01e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a52251400 00000020:00080000:2.0:1784403380.979573:0:6314:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1784403380.979969:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1784403380.980150:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1784403380.980172:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260873088:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784403380.980252:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403380.980294:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784403380.980300:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260873216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784403380.980322:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403380.980348:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784403380.980356:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260873344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784403380.980380:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403380.980410:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260873088 00000100:00100000:2.0:1784403380.980416:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260873088 00000100:00100000:2.0:1784403380.980458:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260873216 00000100:00100000:2.0:1784403380.980461:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260873216 00000100:00100000:2.0:1784403380.980472:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260873344 00000100:00100000:2.0:1784403380.980474:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260873344 00000100:00100000:2.0:1784403380.980490:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784403380.980498:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3565:x1871082260873088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784403380.980525:0:7102:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1784403380.980550:0:7102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.980571:0:7102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afb3d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edb3 expref: 12 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.980580:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784403380.980584:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784403380.980588:0:7102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403380.980919:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:11620:x1871082240964352:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 Request processed in 33605us (33836us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403380.980929:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 227 00010000:00010000:2.0:1784403380.981504:0:7102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afb3d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edb3 expref: 12 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.981530:0:7102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afb3d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edb3 expref: 12 pid: 7101 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403380.981544:0:7102:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7102:1871082260873472:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403380.981603:0:7102:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1784403380.981812:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784403380.981823:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3565:x1871082260873216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784403380.982821:0:8571:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784403380.982827:0:8571:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1784403381 00002000:00010000:2.0:1784403380.982830:0:8571:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784403380.982832:0:8571:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1784403381 -> 1784403381 00002000:00010000:2.0:1784403380.982844:0:8571:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1784403380.983100:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403380.983116:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3565:x1871082260873216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1294us (2792us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1784403380.983127:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784403380.983151:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240964480 00000100:00100000:2.0:1784403380.983220:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240964480 00000100:00100000:2.0:1784403380.983251:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784403380.983259:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3568:x1871082260873344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784403380.983281:0:8571:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1784403380.983309:0:8571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5bd5b4, atime: 0x6a5bd5b4, ctime: 0x6a5bd5b4, blocks: 0x1 00010000:00010000:2.0:1784403380.983318:0:8571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f4bbf90/0x6828175665afb61e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.983578:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1784403380.983584:0:8571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403380.983591:0:8571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f4bbf90/0x6828175665afb61e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.983608:0:8571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f4bbf90/0x6828175665afb61e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.983618:0:8571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f4bbf90/0x6828175665afb61e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.983634:0:8571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f4bbf90/0x6828175665afb61e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403380.983651:0:8571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403380.985104:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403380.985115:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f4bbf90/0x6828175665afb61e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.985126:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3e00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403380.985131:0:6279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f4bbf90/0x6828175665afb61e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.985140:0:6279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f4bbf90/0x6828175665afb61e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.985158:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f4bbf90/0x6828175665afb61e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.985167:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f4bbf90/0x6828175665afb61e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.985200:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403380.985202:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403380.985204:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403380.985235:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3568:x1871082260873344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1975us (4851us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784403380.985244:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784403380.985273:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:2.0:1784403380.985284:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+13:2361:x1871082240964480:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1784403380.985350:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:2.0:1784403380.985594:0:3568:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a774bb800/2, rc 0, transno 4294967310 00000100:00100000:2.0:1784403380.985602:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260873344:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784403380.985911:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240964608 00000100:00100000:3.0:1784403380.985919:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240964608 00010000:00010000:3.0:1784403380.985948:0:6277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afb3d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edb3 expref: 14 pid: 7101 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403380.985975:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:3.0:1784403380.985981:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2361:x1871082240964608:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403380.985993:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403380.985998:0:6277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afb3d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edb3 expref: 14 pid: 7101 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.986010:0:6277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afb3d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edb3 expref: 14 pid: 7101 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.986031:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784403380.986036:0:6277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784403380.986041:0:6277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.986051:0:6277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.986098:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403380.986143:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+14:2361:x1871082240964608:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 162us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403380.986149:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 82 00000004:00080000:0.0:1784403380.986225:0:3565:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a456bc380/2, rc 0, transno 4294967321 00000100:00100000:0.0:1784403380.986233:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260873216:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1784403380.986370:0:7102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afb3d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890edb3 expref: 13 pid: 7101 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403380.986383:0:7102:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7102:1871082260873472:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403380.986473:0:7102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.986484:0:7102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.986490:0:7102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.986500:0:7102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.986509:0:7102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403380.986533:0:7102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784403380.986766:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403380.986772:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.986794:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403380.986798:0:6280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.986808:0:6280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.986824:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.986831:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dd4e2d5/0x6828175665afb617 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403380.986860:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403380.986862:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403380.986863:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403380.988410:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3565:x1871082260873088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7906us (8152us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1784403380.988422:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1784403380.988498:0:3565:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a72e1e680/2, rc 0, transno 4294967322 00000100:00100000:3.0:1784403380.988505:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260873088:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1784403381.031163:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:3.0:1784403381.031182:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1784403381.031187:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1784403381.031404:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2361:x1871082240964480:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 Request processed in 46116us (48299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403381.031417:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:3.0:1784403381.034395:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403381.035043:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240964864 00000100:00100000:0.0:1784403381.035114:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240964864 00000100:00100000:0.0:1784403381.035225:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 228 00000100:00100000:0.0:1784403381.035237:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:11620:x1871082240964864:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784403381.035291:0:6294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403381.035319:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb602 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee46 expref: 20 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.035353:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:0.0:1784403381.035359:0:6294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403381.035391:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.035406:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.035416:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784403381.035825:0:6294:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0cf1580 reply state 000000002303bdac transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403381.035847:0:6294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784403381.036027:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:11620:x1871082240964864:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 790us (1639us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1784403381.036035:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 228 00000100:00080000:2.0:1784403381.036577:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403381.039639:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403381.039771:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240964992 00000100:00100000:2.0:1784403381.039793:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240964992 00000100:00100000:2.0:1784403381.039887:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:2.0:1784403381.039897:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240964992:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784403381.040108:0:7099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784403381.040112:0:7099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1784403381 -> 1784403380 00002000:00010000:2.0:1784403381.040114:0:7099:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1784403380 00002000:00010000:2.0:1784403381.040116:0:7099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1784403381 -> 1784403380 00002000:00010000:2.0:1784403381.040118:0:7099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784403381.040178:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2360:x1871082240964992:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 277us (543us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1784403381.040186:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00080000:1.0:1784403381.040766:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784403381.042754:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.042770:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.042778:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.042784:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403381.042788:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.042812:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.042829:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:0.0:1784403381.042841:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403381.042846:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.042852:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4000/0x6828175665afb625 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403381.043302:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403381.043366:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240965248 00000100:00100000:2.0:1784403381.043374:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240965248 00000100:00100000:2.0:1784403381.043421:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 229 00000100:00100000:2.0:1784403381.043431:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:11620:x1871082240965248:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784403381.043497:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.043512:0:6293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee38 expref: 20 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.043521:0:6293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.043561:0:6293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee38 expref: 20 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.043570:0:6293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee38 expref: 20 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403381.043587:0:6293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260873600:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403381.043784:0:6293:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce600 going to sleep for 11 seconds 00000100:00100000:3.0:1784403381.046474:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403381.046559:0:6293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6293:1871082260873600:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403381.046581:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240965376 00010000:00010000:2.0:1784403381.046586:0:6293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403381.046589:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240965376 00010000:00010000:0.0:1784403381.046624:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee38 expref: 21 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403381.047345:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:0.0:1784403381.047359:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:2360:x1871082240965376:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403381.047377:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403381.047396:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee38 expref: 21 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.047409:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee38 expref: 21 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.047437:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40030400/0x6828175665afb5e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee38 expref: 21 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.047470:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:0.0:1784403381.047476:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.047486:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.047493:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.047525:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403381.047583:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:2360:x1871082240965376:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 227us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403381.047590:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 83 00010000:00010000:2.0:1784403381.047754:0:6293:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.047762:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.047793:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.047800:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.047806:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.047812:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403381.047817:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.047824:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.047843:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:2.0:1784403381.047853:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784403381.047858:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.047946:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb62c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403381.048135:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:11620:x1871082240965248:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 Request processed in 4704us (4837us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784403381.048143:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 229 00000100:00100000:1.0:1784403381.050758:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403381.050806:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240965504 00000100:00100000:3.0:1784403381.050818:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240965504 00000100:00100000:3.0:1784403381.050996:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:3.0:1784403381.051008:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2358:x1871082240965504:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784403381.051060:0:7102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.051082:0:7102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 8 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.051090:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403381.051095:0:7102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784403381.051198:0:7102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.051236:0:7102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 8 pid: 7101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.051258:0:7102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 8 pid: 7101 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403381.051273:0:7102:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7102:1871082260873728:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403381.051358:0:7102:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a5b787600 going to sleep for 11 seconds 00000100:00100000:2.0:1784403381.054219:0:7102:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7102:1871082260873728:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403381.054254:0:7102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403381.054450:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403381.055045:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240965632 00000100:00100000:1.0:1784403381.055187:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240965632 00010000:00010000:1.0:1784403381.055244:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 9 pid: 7101 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403381.055333:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:1.0:1784403381.055345:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+9:2361:x1871082240965632:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403381.055364:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403381.055390:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 9 pid: 7101 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403381.055404:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 9 pid: 7101 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403381.055427:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031b4c15e/0x6828175665afb610 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee54 expref: 9 pid: 7101 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403381.055444:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784403381.055449:0:6278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784403381.055454:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403381.055475:0:6278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403381.055508:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403381.055575:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2361:x1871082240965632:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 232us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403381.055582:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 84 00010000:00010000:3.0:1784403381.055660:0:7102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.055669:0:7102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.055695:0:7102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.055703:0:7102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.055712:0:7102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.055719:0:7102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403381.055724:0:7102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.055747:0:7102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.055759:0:7102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.055766:0:7102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb633 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403381.055826:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2358:x1871082240965504:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 Request processed in 4820us (5074us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403381.055843:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:3.0:1784403381.058938:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403381.059326:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240965888 00000100:00100000:2.0:1784403381.059335:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240965888 00000100:00100000:2.0:1784403381.059395:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 230 00000100:00100000:2.0:1784403381.059405:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:11620:x1871082240965888:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784403381.059492:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb63a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.059509:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb63a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.059530:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb63a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.059969:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.060002:0:10011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb5f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee3f expref: 20 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.060016:0:10011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.060302:0:10011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee3f expref: 20 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.060318:0:10011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb5f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee3f expref: 20 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403381.060334:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260873856:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403381.060422:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce600 going to sleep for 11 seconds 00000100:00100000:2.0:1784403381.064831:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260873856:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403381.064908:0:10011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403381.065139:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403381.065267:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240966016 00000100:00100000:0.0:1784403381.065275:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240966016 00010000:00010000:0.0:1784403381.065312:0:6276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb5f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee3f expref: 21 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403381.065348:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:0.0:1784403381.065357:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:2360:x1871082240966016:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403381.065372:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403381.065379:0:6276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb5f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee3f expref: 21 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.066285:0:6276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee3f expref: 21 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.066335:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb5f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee3f expref: 21 pid: 6293 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.066352:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:0.0:1784403381.066356:0:6276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.066366:0:6276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.066374:0:6276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.066813:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403381.067058:0:10011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.067067:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784403381.067257:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1784403381.067396:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1784403381.067438:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1784403381.067924:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:2360:x1871082240966016:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2562us (2781us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403381.067945:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:2.0:1784403381.067995:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260873984:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784403381.068065:0:10011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403381.068161:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce900 going to sleep for 11 seconds 00000100:00100000:0.0:1784403381.068221:0:6298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260873984 00000100:00100000:0.0:1784403381.068228:0:6298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260873984 00000100:00100000:0.0:1784403381.068268:0:6298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784403381.068277:0:6298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10011:x1871082260873984:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784403381.068357:0:6298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10011:x1871082260873984:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403381.068364:0:6298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784403381.068428:0:10011:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1784403381.068433:0:10011:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1784403381.068451:0:10011:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a456bc380, transno 4294967321 00000100:00100000:2.0:1784403381.068474:0:10011:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8c8a72e1e680 x1871082260873088/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784403396 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403381.068485:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260873984:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1784403381.070508:0:10011:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1784403381.070845:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a774bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260874112:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784403381.071249:0:10011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403381.071276:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce600 going to sleep for 11 seconds 00000100:00100000:1.0:1784403381.071370:0:12944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260874112 00000100:00100000:1.0:1784403381.071378:0:12944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260874112 00000100:00100000:1.0:1784403381.071505:0:12944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784403381.071514:0:12944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10011:x1871082260874112:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784403381.071919:0:12944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:10011:x1871082260874112:12345-0@lo:1000:mdt00_003.0 Request processed in 403us (669us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1784403381.071926:0:12944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784403381.072031:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a774bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10011:1871082260874112:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784403381.072069:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072079:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072086:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072092:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403381.072174:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072194:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072210:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:3.0:1784403381.072213:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403381.072217:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072223:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afb641 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072253:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072260:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072266:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072270:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40031400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403381.072273:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072279:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072288:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403381.072290:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784403381.072297:0:10011:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb58b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee23 expref: 23 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072320:0:10011:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb58b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee23 expref: 23 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072328:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb58b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee23 expref: 23 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.072357:0:10011:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb58b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee23 expref: 23 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403381.072369:0:10011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260874240:192.168.204.28@tcp:105: 00000100:00100000:3.0:1784403381.072426:0:10011:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a5b787600 going to sleep for 11 seconds 00000100:00100000:1.0:1784403381.080337:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403381.080483:0:10011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a456bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10011:1871082260874240:192.168.204.28@tcp:105: 00010000:00010000:3.0:1784403381.080518:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080528:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031400/0x6828175665afb584 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080565:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb648 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080580:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080591:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080603:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403381.080664:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240966144 00000100:00100000:2.0:1784403381.080671:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240966144 00000100:00100000:2.0:1784403381.080729:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:2.0:1784403381.080739:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:11619:x1871082240966144:12345-192.168.204.28@tcp:49:lfs.0 00010000:00010000:3.0:1784403381.080851:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb648 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080857:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb648 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403381.080909:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+24:11619:x1871082240966144:12345-192.168.204.28@tcp:49:lfs.0 Request processed in 170us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403381.080917:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00010000:00010000:3.0:1784403381.080929:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403381.080943:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb648 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080952:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb648 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080966:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403381.080969:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403381.080973:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb648 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080978:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb648 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080988:0:10011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb63a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.080994:0:10011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb63a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.081000:0:10011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb63a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.081005:0:10011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403381.081016:0:10011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb63a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.081022:0:10011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb63a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.081030:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403381.081032:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784403381.081036:0:10011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb63a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.081042:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3e00/0x6828175665afb63a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403381.081730:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:11620:x1871082240965888:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 22322us (22799us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1784403381.081851:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 230 00000020:00080000:3.0:1784403381.081856:0:10011:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784403381.082054:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784403381.082059:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784403381.082547:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1784403381.082555:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784403381.086007:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403381.086409:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240966400 00000100:00100000:3.0:1784403381.086420:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240966400 00000100:00100000:3.0:1784403381.086525:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:3.0:1784403381.086537:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+23:11620:x1871082240966400:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784403381.087371:0:6296:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784403381.087493:0:6296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1784403381.087542:0:6296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.087559:0:6296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.087571:0:6296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.087585:0:6296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.087591:0:6296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.087596:0:6296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.087616:0:6296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403381.087776:0:8813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403381.087783:0:8813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403381.087791:0:8813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403381.087796:0:8813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403381.087803:0:8813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403381.087817:0:8813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c8a43245100) 00010000:00010000:1.0:1784403381.087820:0:8813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784403381.087825:0:8813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403381.087846:0:8813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb64f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403381.087879:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403381.087881:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403381.087883:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403381.087929:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403381.088446:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+25:11620:x1871082240966400:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 1906us (2444us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1784403381.088457:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 62 00000020:00080000:3.0:1784403381.088463:0:6296:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784403381.088577:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403381.089739:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240966656 00000100:00100000:3.0:1784403381.089752:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240966656 00000100:00100000:3.0:1784403381.089801:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 231 00000100:00100000:3.0:1784403381.089811:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+25:11619:x1871082240966656:12345-192.168.204.28@tcp:58:lfs.0 00000040:00080000:3.0:1784403381.090085:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1784403381.090167:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+25:11619:x1871082240966656:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 356us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403381.090179:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 231 00000100:00100000:0.0:1784403381.127117:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403381.127429:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240966784 00000100:00100000:3.0:1784403381.127439:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240966784 00000100:00100000:3.0:1784403381.127516:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 232 00000100:00100000:3.0:1784403381.127528:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a730d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+25:11622:x1871082240966784:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403381.127552:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403381.127589:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb656 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee5b expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.127850:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb65d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.127898:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb65d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.127911:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb65d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.127927:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb664 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.127935:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403381.127942:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.128587:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.128772:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee1c expref: 26 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.128784:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.128826:0:6294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee1c expref: 26 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.128852:0:6294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee1c expref: 26 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403381.128898:0:6294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77498700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260874368:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403381.128983:0:6294:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cc25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784403381.132268:0:6294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77498700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6294:1871082260874368:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403381.132302:0:6294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403381.133743:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403381.134084:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240967040 00000100:00100000:1.0:1784403381.134172:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240967040 00000100:00100000:1.0:1784403381.134613:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:1.0:1784403381.134626:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:5573:x1871082240967040:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784403381.134916:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:5573:x1871082240967040:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 293us (1179us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1784403381.134924:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:1.0:1784403381.140274:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403381.140824:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240967168 00000100:00100000:3.0:1784403381.140845:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240967168 00010000:00010000:3.0:1784403381.141007:0:6278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee1c expref: 28 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403381.141298:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:0.0:1784403381.141604:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:2361:x1871082240967168:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403381.141745:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403381.141754:0:6278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee1c expref: 28 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.141771:0:6278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee1c expref: 28 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.141814:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2400/0x6828175665afb576 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee1c expref: 28 pid: 10011 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.142033:0:6278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:0.0:1784403381.142040:0:6278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.142361:0:6278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.142371:0:6278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403381.142444:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784403381.142737:0:6294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.142747:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403381.142794:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784403381.142799:0:6294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403381.142818:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.142841:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403381.143274:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:2361:x1871082240967168:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1961us (3079us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403381.143285:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 86 00010000:00010000:2.0:1784403381.143359:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb65d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143367:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb65d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143375:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb65d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143381:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403381.143385:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb65d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143394:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb65d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143406:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:2.0:1784403381.143409:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403381.143413:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb65d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143420:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7e00/0x6828175665afb65d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143448:0:6294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143454:0:6294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb664 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143461:0:6294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb664 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143467:0:6294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403381.143470:0:6294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb664 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143476:0:6294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb664 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143484:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c8a43245200) 00010000:00010000:2.0:1784403381.143487:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403381.143490:0:6294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb664 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.143497:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb664 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.144783:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb656 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee5b expref: 27 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.144810:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee5b expref: 26 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403381.144846:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:2.0:1784403381.144849:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784403381.145360:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4200, rc 0) 00000100:00100000:2.0:1784403381.145427:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a730d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:11622:x1871082240966784:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 17900us (18319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403381.145435:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 232 00000001:00080000:1.0:1784403381.545192:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1784403381.545335:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000040:00080000:1.0:1784403382.056693:0:12985:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784403382.056703:0:12985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784403382.056753:0:12985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784403382.056759:0:12985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784403382.111120:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784403382.111298:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784403382.111305:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784403382.111360:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784403382.111367:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784403382.111494:0:12049:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260874496:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784403382.111722:0:12049:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a65fb1840 going to sleep for 11 seconds 00000100:00100000:1.0:1784403382.115122:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403382.115293:0:12049:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12049:1871082260874496:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784403382.118553:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240967296 00000100:00100000:1.0:1784403382.118567:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240967296 00000100:00100000:1.0:1784403382.118664:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 233 00000100:00100000:1.0:1784403382.118676:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:11635:x1871082240967296:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784403382.118715:0:6293:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784403382.118848:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:11635:x1871082240967296:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 174us (3736us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403382.118857:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 233 00000100:00100000:2.0:1784403382.124838:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403382.124960:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240967552 00000100:00100000:3.0:1784403382.124970:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240967552 00000100:00100000:3.0:1784403382.125041:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 234 00000100:00100000:3.0:1784403382.125052:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+26:11635:x1871082240967552:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403382.125081:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403382.125104:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb672 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee62 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403382.125205:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb679 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403382.125227:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403382.125240:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403382.125252:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784403382.125377:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb672 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee62 expref: 29 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403382.125397:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee62 expref: 28 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403382.125406:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403382.125409:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403382.125412:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6600, rc 0) 00000100:00100000:3.0:1784403382.125465:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:11635:x1871082240967552:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 415us (639us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1784403382.125472:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 234 00000100:00100000:3.0:1784403382.128967:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403382.131297:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240967680 00000100:00100000:1.0:1784403382.131311:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240967680 00000100:00100000:1.0:1784403382.131417:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:1.0:1784403382.131428:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:2360:x1871082240967680:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784403382.131445:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403382.131471:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb679 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee62 expref: 28 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403382.131489:0:6276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:1.0:1784403382.131494:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403382.131549:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:2360:x1871082240967680:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 123us (2592us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403382.131557:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1784403382.135226:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403382.138135:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240967936 00000100:00100000:0.0:1784403382.138151:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240967936 00000100:00100000:0.0:1784403382.138218:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 235 00000100:00100000:0.0:1784403382.138230:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+27:11635:x1871082240967936:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784403382.138317:0:6293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb687 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403382.138338:0:6293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb687 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403382.138350:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb687 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403382.138552:0:6293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb687 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403382.138560:0:6293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb687 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403382.138566:0:6293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb687 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403382.138573:0:6293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403382.138578:0:6293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb687 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403382.138586:0:6293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb687 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403382.138674:0:6293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:0.0:1784403382.138677:0:6293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784403382.138682:0:6293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb687 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403382.138689:0:6293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb687 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403382.138851:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:11635:x1871082240967936:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 623us (3634us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1784403382.138860:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 235 00000040:00080000:0.0:1784403382.139802:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403382.139810:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784403382.141529:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1784403382.141556:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784403382.142966:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403382.143072:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240968192 00000100:00100000:2.0:1784403382.143082:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240968192 00000100:00100000:2.0:1784403382.143132:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:2.0:1784403382.143144:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+28:11635:x1871082240968192:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784403382.143367:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:11635:x1871082240968192:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 225us (409us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1784403382.143374:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:1.0:1784403382.846101:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403382.846141:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403382.846171:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403382.846206:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403382.846308:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240968320 00000100:00100000:0.0:1784403382.846319:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240968320 00000100:00100000:0.0:1784403382.846384:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 301 00000100:00100000:0.0:1784403382.846395:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240968320:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403382.846415:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240968832 00000100:00100000:3.0:1784403382.846420:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240968832 00000100:00100000:0.0:1784403382.846470:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240968320:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 76us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403382.846477:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240968448 00000100:00100000:0.0:1784403382.846477:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 301 00000100:00100000:3.0:1784403382.846480:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240968448 00000100:00100000:3.0:1784403382.846499:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 162 00000100:00100000:3.0:1784403382.846505:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2359:x1871082240968832:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403382.846512:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 163 00000100:00100000:0.0:1784403382.846519:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:2359:x1871082240968448:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403382.846537:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2359:x1871082240968832:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403382.846542:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:2359:x1871082240968448:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403382.846544:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 162 00000100:00100000:0.0:1784403382.846548:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 163 00000100:00080000:3.0:1784403382.846560:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403382.847537:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240968576 00000100:00100000:2.0:1784403382.847546:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240968576 00000100:00100000:2.0:1784403382.847607:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:2.0:1784403382.847616:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2359:x1871082240968576:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403382.847665:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2359:x1871082240968576:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 50us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403382.847672:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:2.0:1784403382.850296:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403382.850397:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240968704 00000100:00100000:0.0:1784403382.850407:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240968704 00000100:00100000:0.0:1784403382.850567:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00100000:0.0:1784403382.850580:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240968704:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403382.850662:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240968704:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 85us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403382.850670:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00080000:3.0:1784403382.850744:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784403383.136712:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403383.528147:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260874624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784403383.528226:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403383.529138:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260874624 00000100:00100000:0.0:1784403383.529149:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260874624 00000100:00100000:0.0:1784403383.529220:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784403383.529229:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3568:x1871082260874624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784403383.529266:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784403383.539997:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3568:x1871082260874624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10758us (11759us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403383.540022:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1784403383.540055:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403383.545799:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260874624:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1784403384.024459:0:13036:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784403384.024469:0:13036:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784403384.024520:0:13036:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784403384.024526:0:13036:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1784403384.162263:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403384.185793:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403384.185831:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240969088 00000100:00100000:3.0:1784403384.185841:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240969088 00000100:00100000:3.0:1784403384.185930:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 236 00000100:00100000:3.0:1784403384.185941:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+29:11655:x1871082240969088:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1784403384.185961:0:10011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403384.185984:0:10011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb68e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee69 expref: -99 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403384.186083:0:10011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb695 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403384.186099:0:10011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403384.186125:0:10011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403384.186138:0:10011:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784403384.186264:0:10011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6600/0x6828175665afb68e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee69 expref: 32 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403384.186282:0:10011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee69 expref: 31 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403384.186290:0:10011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:3.0:1784403384.186293:0:10011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784403384.186297:0:10011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:3.0:1784403384.186352:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:11655:x1871082240969088:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 413us (578us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1784403384.186361:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 236 00000100:00080000:3.0:1784403384.186383:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403384.190086:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403384.190126:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240969216 00000100:00100000:0.0:1784403384.190136:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240969216 00000100:00100000:0.0:1784403384.190189:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 237 00000100:00100000:0.0:1784403384.190201:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:11655:x1871082240969216:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:0.0:1784403384.190271:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb6a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403384.190289:0:6292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403384.190305:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403384.190332:0:6292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403384.190340:0:6292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb6a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403384.190347:0:6292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403384.190353:0:6292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5600 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403384.190364:0:6292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403384.190372:0:6292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb6a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403384.190383:0:6292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:0.0:1784403384.190386:0:6292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784403384.190390:0:6292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb6a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403384.190396:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afb6a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403384.190463:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+31:11655:x1871082240969216:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 264us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403384.190481:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 237 00000100:00100000:2.0:1784403384.348788:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403384.348892:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240969344 00000100:00100000:3.0:1784403384.348904:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240969344 00000100:00100000:3.0:1784403384.348990:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:3.0:1784403384.349001:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2358:x1871082240969344:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:3.0:1784403384.349020:0:7099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1784403384.349021:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784403384.349043:0:7099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afb6aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee70 expref: -99 pid: 7099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784403384.349071:0:7099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a5bd5b4, atime: 0x6a5bd5b4, ctime: 0x6a5bd5b4, blocks: 0xb 00010000:00010000:3.0:1784403384.349092:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=389s v=(0 0) 00010000:00010000:3.0:1784403384.349111:0:7099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403384.349122:0:7099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afb6aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee70 expref: 8 pid: 7099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403384.349142:0:7099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afb6aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee70 expref: 8 pid: 7099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403384.349157:0:7099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6600, rc 0) 00000100:00100000:3.0:1784403384.349220:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2358:x1871082240969344:12345-192.168.204.28@tcp:101:cat.0 Request processed in 221us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403384.349228:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:0.0:1784403384.360299:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403384.360431:0:7106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240969472 00000100:00100000:1.0:1784403384.360451:0:7106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240969472 00002000:00100000:1.0:1784403384.360532:0:7106:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8c8a72f06a00 x1871082240969472/t0(0) o3->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:155/0 lens 488/0 e 0 to 0 dl 1784403395 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784403384.360543:0:7106:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a72f06a00 with x1871082240969472 ext(0->4095) 00002000:00010000:1.0:1784403384.360550:0:7106:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a72f06a00 00000100:00100000:1.0:1784403384.360604:0:7106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:1.0:1784403384.360615:0:7106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2359:x1871082240969472:12345-192.168.204.28@tcp:3:cat.0 00000100:00100000:1.0:1784403384.361246:0:7106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+8:2359:x1871082240969472:12345-192.168.204.28@tcp:3:cat.0 Request processed in 630us (960us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1784403384.361256:0:7106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00002000:00100000:1.0:1784403384.361263:0:7106:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8c8a72f06a00 x1871082240969472/t0(0) o3->becd6ccb-dd35-46e6-9ecf-44ee31a105f1@192.168.204.28@tcp:155/0 lens 488/4536 e 0 to 0 dl 1784403395 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784403384.361272:0:7106:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c8a72f06a00 with x1871082240969472 ext(0->4095) 00002000:00010000:1.0:1784403384.361276:0:7106:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c8a72f06a00 00010000:00010000:2.0:1784403385.183110:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784403385.253647:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784403385.253657:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784403385.253705:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784403385.253712:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784403385.569272:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260875008:0@lo:400:kworker.0 00000100:00100000:1.0:1784403385.569348:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403385.569421:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784403385.569428:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260875136:0@lo:400:kworker.0 00000100:00100000:1.0:1784403385.569455:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403385.569489:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260875136 00000100:00100000:1.0:1784403385.569496:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260875136 00000100:00100000:1.0:1784403385.569553:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784403385.569564:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260875136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403385.569618:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260875136:12345-0@lo:400:kworker.0 Request processed in 57us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403385.569625:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1784403385.569646:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403385.569699:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260875136:0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.569815:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260874752:0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.569850:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403385.569897:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a81b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260875264:0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.569920:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403385.569940:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784403385.569946:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260874880:0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.569966:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403385.569983:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260875392:0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.570017:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403385.570047:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260874752 00000100:00100000:3.0:1784403385.570051:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260874752 00000100:00100000:3.0:1784403385.570081:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784403385.570088:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260874752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.570123:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260874752:12345-0@lo:400:kworker.0 Request processed in 36us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403385.570138:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784403385.570167:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260875008 00000100:00100000:3.0:1784403385.570170:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260875008 00000100:00100000:3.0:1784403385.570199:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260875264 00000100:00100000:3.0:1784403385.570202:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260875264 00000100:00100000:3.0:1784403385.570216:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260874880 00000100:00100000:3.0:1784403385.570218:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260874880 00000100:00100000:3.0:1784403385.570232:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784403385.570238:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260875008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.570281:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260875008:12345-0@lo:400:kworker.0 Request processed in 43us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403385.570288:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784403385.570301:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784403385.570307:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260875264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.570336:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260875264:12345-0@lo:400:kworker.0 Request processed in 30us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403385.570342:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784403385.570353:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784403385.570359:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260874880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.570383:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260874880:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403385.570389:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784403385.570412:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260875392 00000100:00100000:3.0:1784403385.570415:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260875392 00000100:00100000:3.0:1784403385.570442:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784403385.570448:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a456bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260875392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.570487:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a456bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260875392:12345-0@lo:400:kworker.0 Request processed in 39us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403385.570493:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1784403385.570517:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784403385.570521:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403385.570539:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260874880:0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.570547:0:3565:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1784403385.570552:0:3565:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a73604700, transno 4294967307 00000004:00080000:3.0:1784403385.570563:0:3565:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1784403385.570580:0:3565:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a774bb800, transno 4294967310 00000100:00100000:3.0:1784403385.570584:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260875392:0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.570593:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260874752:0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.570602:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a81b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260875264:0@lo:400:kworker.0 00000100:00100000:3.0:1784403385.570898:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260875008:0@lo:400:kworker.0 00000100:00100000:2.0:1784403386.079263:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784403386.079288:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260875520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784403386.079376:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403386.079454:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260875520 00000100:00100000:2.0:1784403386.079462:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260875520 00000100:00100000:2.0:1784403386.079528:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784403386.079538:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260875520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403386.079575:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403386.079633:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260875520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403386.079640:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784403386.079688:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260875520:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1784403386.134120:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1784403386.134140:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1784403386.156501:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1784403386.160197:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1784403386.160217:0:6314:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c89410ce900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1784403386.160223:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a738e8c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c89410cef00 00000020:00080000:3.0:1784403386.160227:0:6314:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8c8a738e8300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c8a73a12800 00000020:00080000:3.0:1784403386.160255:0:6314:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1784403386.160267:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1784403386.160325:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1784403386.160570:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1784403386.207019:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403387.232197:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403387.964975:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403387.965025:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403387.965073:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403387.965117:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240969984 00000100:00100000:0.0:1784403387.965130:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403387.965139:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240969984 00000100:00100000:0.0:1784403387.965175:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403387.965241:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240969856 00000100:00100000:1.0:1784403387.965246:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240969856 00000100:00100000:0.0:1784403387.965254:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:0.0:1784403387.965275:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240969984:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403387.965285:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 103 00000100:00100000:1.0:1784403387.965300:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240969856:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403387.965389:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2360:x1871082240969984:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 120us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403387.965400:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:1.0:1784403387.965466:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2360:x1871082240969856:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 168us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403387.965479:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 103 00000100:00080000:1.0:1784403387.965513:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784403387.965518:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403387.965934:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240969728 00000100:00100000:3.0:1784403387.965944:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240969728 00000100:00100000:3.0:1784403387.966025:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240970112 00000100:00100000:3.0:1784403387.966029:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240970112 00000100:00100000:3.0:1784403387.966052:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 167 00000100:00100000:3.0:1784403387.966061:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:2360:x1871082240969728:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403387.966121:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:2360:x1871082240969728:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 62us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403387.966129:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 167 00000100:00100000:3.0:1784403387.966143:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 168 00000100:00100000:3.0:1784403387.966149:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240970112:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403387.966175:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2360:x1871082240970112:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 26us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403387.966180:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 168 00000100:00080000:1.0:1784403387.966487:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403387.966559:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240969600 00000100:00100000:2.0:1784403387.966565:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240969600 00000100:00100000:2.0:1784403387.966607:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 303 00000100:00100000:2.0:1784403387.966615:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240969600:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403387.966665:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240969600:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 51us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403387.966671:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 303 00010000:00010000:2.0:1784403388.263107:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403388.639140:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403388.639161:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260875648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403388.639226:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403388.639278:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260875648 00000100:00100000:2.0:1784403388.639285:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260875648 00000100:00100000:2.0:1784403388.639333:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784403388.639340:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260875648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784403388.639373:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403388.639412:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260875648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403388.639419:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1784403388.639436:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403388.639460:0:3567:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1784403388.639465:0:3567:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a72e1e680, transno 4294967322 00000004:00080000:2.0:1784403388.639476:0:3567:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1784403388.639505:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260875648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784403389.284128:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403389.468646:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403389.468743:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240970240 00000100:00100000:3.0:1784403389.468755:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240970240 00000100:00080000:2.0:1784403389.468918:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403389.469055:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 238 00000100:00100000:3.0:1784403389.469068:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:11300:x1871082240970240:12345-192.168.204.28@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1784403389.469184:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:11300:x1871082240970240:12345-192.168.204.28@tcp:60:lhsmtool_posix.0 Request processed in 119us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403389.469192:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 238 00000100:00100000:1.0:1784403389.476428:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403389.476583:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240970496 00000100:00100000:2.0:1784403389.476602:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240970496 00000100:00100000:2.0:1784403389.476662:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:2.0:1784403389.476674:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:11300:x1871082240970496:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784403389.477258:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:11300:x1871082240970496:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 584us (838us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1784403389.477268:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:1.0:1784403389.939198:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403389.940053:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240970624 00000100:00100000:3.0:1784403389.940065:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240970624 00000100:00080000:2.0:1784403389.940208:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403389.940981:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 239 00000100:00100000:3.0:1784403389.940998:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:12106:x1871082240970624:12345-192.168.204.28@tcp:101:lsof.0 00010000:00010000:3.0:1784403389.941021:0:6294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403389.941044:0:6294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb6b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee77 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403389.941123:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb6b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403389.941137:0:6294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403389.941150:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403389.941332:0:6294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784403389.941337:0:6294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403389.941418:0:6294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403389.941442:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6800/0x6828175665afb6b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee77 expref: 7 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403389.941525:0:6294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee77 expref: 6 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403389.941534:0:6294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:3.0:1784403389.941536:0:6294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784403389.941540:0:6294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7400, rc 0) 00000100:00100000:3.0:1784403389.941679:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:12106:x1871082240970624:12345-192.168.204.28@tcp:101:lsof.0 Request processed in 677us (2481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403389.941687:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 239 00010000:00010000:3.0:1784403390.304766:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403390.687258:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260875904:0@lo:400:kworker.0 00000100:00100000:2.0:1784403390.687344:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403390.687426:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260876416:0@lo:400:kworker.0 00000100:00100000:2.0:1784403390.687455:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403390.687488:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784403390.687495:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a737ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260875776:0@lo:400:kworker.0 00000100:00100000:2.0:1784403390.687524:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403390.687558:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260876288:0@lo:400:kworker.0 00000100:00100000:2.0:1784403390.687582:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403390.687773:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260876416 00000100:00100000:0.0:1784403390.687781:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260876416 00000100:00100000:0.0:1784403390.687860:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784403390.687890:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260876416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403390.687954:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260876416:12345-0@lo:400:kworker.0 Request processed in 66us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403390.687962:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784403390.687990:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260875904 00000100:00100000:0.0:1784403390.687994:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260875904 00000100:00100000:0.0:1784403390.688017:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260876288 00000100:00100000:0.0:1784403390.688019:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260876288 00000100:00100000:0.0:1784403390.688036:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784403390.688042:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260875904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403390.688082:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260875904:12345-0@lo:400:kworker.0 Request processed in 30us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403390.688089:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784403390.688101:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784403390.688106:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260876288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403390.688137:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260876288:12345-0@lo:400:kworker.0 Request processed in 31us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403390.688143:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784403390.688185:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260876288:0@lo:400:kworker.0 00000100:00100000:0.0:1784403390.688197:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260875904:0@lo:400:kworker.0 00000100:00100000:0.0:1784403390.688205:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260876416:0@lo:400:kworker.0 00000100:00080000:2.0:1784403390.688741:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784403390.688747:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403390.688827:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260876160:0@lo:400:kworker.0 00000100:00100000:3.0:1784403390.688918:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403390.688945:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784403390.688952:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a42cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260876032:0@lo:400:kworker.0 00000100:00100000:3.0:1784403390.688977:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403390.689017:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260875776 00000100:00100000:3.0:1784403390.689022:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260875776 00000100:00100000:3.0:1784403390.689059:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1784403390.689067:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260875776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403390.689109:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260875776:12345-0@lo:400:kworker.0 Request processed in 43us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403390.689116:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1784403390.689152:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260876032 00000100:00100000:3.0:1784403390.689156:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260876032 00000100:00100000:3.0:1784403390.689187:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784403390.689194:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260876032:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784403390.689520:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403390.689603:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260876160 00000100:00100000:0.0:1784403390.689627:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260876160 00000100:00100000:0.0:1784403390.689680:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784403390.689688:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260876160:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784403390.689740:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784403390.692487:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a737ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260875776:0@lo:400:kworker.0 00000100:00100000:3.0:1784403390.695187:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260876032:12345-0@lo:400:kworker.0 Request processed in 5983us (6197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403390.695202:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784403390.695386:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260876032:0@lo:400:kworker.0 00000100:00100000:0.0:1784403390.696099:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260876160:12345-0@lo:400:kworker.0 Request processed in 6408us (7176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403390.696111:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784403390.698046:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a42cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260876160:0@lo:400:kworker.0 00000100:00100000:2.0:1784403391.200315:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260876544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784403391.200403:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403391.201144:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260876544 00000100:00100000:1.0:1784403391.201153:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260876544 00000100:00100000:1.0:1784403391.201232:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784403391.201242:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260876544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784403391.201278:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403391.201348:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260876544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403391.201356:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784403391.201805:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260876544:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1784403391.272727:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1784403391.272747:0:6314:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1784403391.273039:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1784403391.273052:0:6325:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1784403391.327132:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403392.352536:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403393.082961:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403393.083001:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240970880 00000100:00100000:0.0:1784403393.083004:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403393.083012:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240970880 00000100:00100000:0.0:1784403393.083051:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403393.083055:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240971136 00000100:00100000:3.0:1784403393.083062:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240971136 00000100:00100000:0.0:1784403393.083083:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403393.083092:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00100000:2.0:1784403393.083104:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:2359:x1871082240970880:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403393.083110:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240971008 00000100:00100000:3.0:1784403393.083114:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240971008 00000100:00100000:0.0:1784403393.083133:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403393.083147:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 106 00000100:00100000:3.0:1784403393.083157:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240971136:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403393.083169:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 107 00000100:00100000:0.0:1784403393.083187:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2359:x1871082240971008:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403393.083207:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:2359:x1871082240970880:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403393.083215:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2359:x1871082240971136:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403393.083219:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00100000:0.0:1784403393.083227:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2359:x1871082240971008:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 45us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403393.083232:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 106 00000100:00100000:2.0:1784403393.083238:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240971264 00000100:00100000:0.0:1784403393.083243:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 107 00000100:00100000:2.0:1784403393.083244:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240971264 00000100:00100000:3.0:1784403393.083261:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240970752 00000100:00100000:3.0:1784403393.083266:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240970752 00000100:00100000:2.0:1784403393.083280:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:2.0:1784403393.083290:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a737ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2359:x1871082240971264:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403393.083300:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 305 00000100:00100000:3.0:1784403393.083309:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240970752:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403393.083343:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a737ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2359:x1871082240971264:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 53us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403393.083351:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:3.0:1784403393.083365:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240970752:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 55us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403393.083374:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 305 00000100:00080000:0.0:1784403393.083441:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784403393.083446:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784403393.083448:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1784403393.222489:0:13239:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:36:32 (1784403392) 00010000:00010000:2.0:1784403393.380808:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403393.760091:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403393.760119:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260876672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403393.760190:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403393.760327:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260876672 00000100:00100000:1.0:1784403393.760335:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260876672 00000100:00100000:1.0:1784403393.760402:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784403393.760426:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260876672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784403393.760460:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403393.760506:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260876672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403393.760514:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1784403393.760532:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403393.760557:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260876672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784403394.402794:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403395.423144:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784403395.487185:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784403395.487195:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784403395.487977:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1784403395.487987:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784403395.807662:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260876928:0@lo:400:kworker.0 00000100:00100000:0.0:1784403395.807751:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403395.807820:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260877440:0@lo:400:kworker.0 00000100:00100000:0.0:1784403395.807846:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403395.807898:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784403395.807905:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260876800:0@lo:400:kworker.0 00000100:00100000:0.0:1784403395.807942:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403395.807960:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260877312:0@lo:400:kworker.0 00000100:00100000:0.0:1784403395.807979:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403395.808119:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260876928 00000100:00100000:2.0:1784403395.808126:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260876928 00000100:00100000:2.0:1784403395.808180:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260877312 00000100:00100000:2.0:1784403395.808183:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260877312 00000100:00100000:2.0:1784403395.808217:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784403395.808226:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260876928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403395.808277:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260876928:12345-0@lo:400:kworker.0 Request processed in 52us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403395.808284:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784403395.808300:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784403395.808306:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260877312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403395.808330:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260877312:12345-0@lo:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403395.808335:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1784403395.808353:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403395.808532:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260877184:0@lo:400:kworker.0 00000100:00100000:3.0:1784403395.808577:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403395.808608:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784403395.808615:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a52370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260877056:0@lo:400:kworker.0 00000100:00100000:3.0:1784403395.808637:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403395.808674:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260877440 00000100:00100000:3.0:1784403395.808678:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260877440 00000100:00100000:3.0:1784403395.808712:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260877184 00000100:00100000:3.0:1784403395.808715:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260877184 00000100:00100000:3.0:1784403395.808735:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784403395.808741:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260877440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403395.808773:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260877440:12345-0@lo:400:kworker.0 Request processed in 32us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403395.808779:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784403395.808800:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784403395.808806:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a774bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260877184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403395.808853:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a774bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260877184:12345-0@lo:400:kworker.0 Request processed in 47us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403395.808859:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784403395.808904:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260876800 00000100:00100000:3.0:1784403395.808907:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260876800 00000100:00100000:3.0:1784403395.808931:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784403395.808937:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260876800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403395.808968:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64472369-fee1-4bb4-a407-7797860a37a0+19:3566:x1871082260876800:12345-0@lo:400:kworker.0 Request processed in 31us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403395.808973:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:3.0:1784403395.809007:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784403395.809010:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403395.809038:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260877184:0@lo:400:kworker.0 00000100:00100000:3.0:1784403395.809060:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260877056 00000100:00100000:3.0:1784403395.809063:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260877056 00000100:00100000:3.0:1784403395.809093:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784403395.809099:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a81b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260877056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403395.809143:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a81b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3568:x1871082260877056:12345-0@lo:400:kworker.0 Request processed in 43us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403395.809149:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1784403395.809162:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403395.809178:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3568:1871082260877056:0@lo:400:kworker.0 00000100:00100000:0.0:1784403395.810344:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64472369-fee1-4bb4-a407-7797860a37a0:3566:1871082260876800:0@lo:400:kworker.0 00000100:00100000:0.0:1784403395.810361:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260877312:0@lo:400:kworker.0 00000100:00100000:0.0:1784403395.810372:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a52370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260876928:0@lo:400:kworker.0 00000100:00100000:0.0:1784403395.810384:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260877440:0@lo:400:kworker.0 00000100:00100000:1.0:1784403396.319782:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260877568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403396.319856:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403396.319992:0:7103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260877568 00000100:00100000:1.0:1784403396.320000:0:7103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260877568 00000100:00100000:1.0:1784403396.320057:0:7103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784403396.320067:0:7103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260877568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784403396.320104:0:7103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403396.321338:0:7103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260877568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1267us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403396.321350:0:7103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784403396.321442:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260877568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784403396.447227:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403397.363109:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403397.367137:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240971520 00000100:00100000:2.0:1784403397.367199:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240971520 00000100:00100000:2.0:1784403397.367299:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:2.0:1784403397.367313:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+18:12327:x1871082240971520:12345-192.168.204.28@tcp:35:umount.0 00000100:00080000:3.0:1784403397.367505:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403397.368160:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:12327:x1871082240971520:12345-192.168.204.28@tcp:35:umount.0 Request processed in 846us (5056us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1784403397.368169:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:3.0:1784403397.374778:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403397.375551:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240971776 00000100:00100000:2.0:1784403397.375563:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240971776 00000100:00100000:2.0:1784403397.375682:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:2.0:1784403397.375692:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+19:12327:x1871082240971776:12345-192.168.204.28@tcp:35:umount.0 00000100:00100000:2.0:1784403397.377129:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:12327:x1871082240971776:12345-192.168.204.28@tcp:35:umount.0 Request processed in 1430us (2353us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1784403397.377140:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:3.0:1784403397.381693:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403397.381916:0:6296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240972032 00000100:00100000:1.0:1784403397.381934:0:6296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240972032 00000100:00100000:1.0:1784403397.382006:0:6296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:1.0:1784403397.382018:0:6296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a497a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+20:12327:x1871082240972032:12345-192.168.204.28@tcp:35:umount.0 00000100:00100000:1.0:1784403397.383256:0:6296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a497a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:12327:x1871082240972032:12345-192.168.204.28@tcp:35:umount.0 Request processed in 1234us (1566us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1784403397.383268:0:6296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:0.0:1784403397.388159:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403397.388806:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240972288 00000100:00100000:2.0:1784403397.388819:0:6295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240972288 00000100:00100000:2.0:1784403397.388928:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:2.0:1784403397.388940:0:6295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+21:12327:x1871082240972288:12345-192.168.204.28@tcp:35:umount.0 00000100:00100000:2.0:1784403397.389331:0:6295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+22:12327:x1871082240972288:12345-192.168.204.28@tcp:35:umount.0 Request processed in 382us (1170us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1784403397.389340:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:3.0:1784403397.400721:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403397.400918:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240972672 00000100:00100000:0.0:1784403397.400928:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240972672 00000100:00100000:0.0:1784403397.400996:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:0.0:1784403397.401007:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2359:x1871082240972672:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403397.401024:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403397.401045:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afa696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890e9ca expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.401063:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403397.401124:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:2359:x1871082240972672:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 119us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403397.401132:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:3.0:1784403397.402702:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403397.402742:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403397.403010:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240972416 00000100:00100000:2.0:1784403397.403019:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240972416 00000100:00100000:1.0:1784403397.403039:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240972544 00000100:00100000:1.0:1784403397.403046:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240972544 00000100:00100000:2.0:1784403397.403077:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1784403397.403088:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+13:2360:x1871082240972416:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403397.403118:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403397.403135:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce4a00/0x6828175665afa730 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea02 expref: 13 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403397.403151:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403397.403193:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:2360:x1871082240972416:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 108us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403397.403200:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1784403397.403217:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:2.0:1784403397.403222:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:2360:x1871082240972544:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403397.403229:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403397.403237:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41670400/0x6828175665afa91a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eacd expref: 11 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403397.403247:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403397.403260:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240972544:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 39us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403397.403266:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:1.0:1784403397.406645:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403397.407037:0:7102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240972800 00000100:00100000:3.0:1784403397.407048:0:7102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240972800 00000100:00100000:3.0:1784403397.407124:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:3.0:1784403397.407136:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2357:x1871082240972800:12345-192.168.204.28@tcp:9:umount.0 00000020:00000080:3.0:1784403397.407166:0:7102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afaa08 00000100:00080000:3.0:1784403397.407175:0:7102:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b608800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784403397.407224:0:7102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1784403397.407240:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784403397.407361:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784403397.407794:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+2:2357:x1871082240972800:12345-192.168.204.28@tcp:9:umount.0 Request processed in 659us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403397.407802:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:3.0:1784403397.418259:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403397.418468:0:7101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240973184 00000100:00100000:2.0:1784403397.418478:0:7101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240973184 00000100:00100000:2.0:1784403397.418575:0:7101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00100000:2.0:1784403397.418585:0:7101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72f04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2357:x1871082240973184:12345-192.168.204.28@tcp:9:umount.0 00000020:00000080:2.0:1784403397.418652:0:7101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afac70 00000020:00010000:2.0:1784403397.418660:0:7101:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c8a7303c000: total 0 00000100:00080000:2.0:1784403397.418664:0:7101:0:(import.c:65:import_set_state_nolock()) ffff8c8a7303a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784403397.418713:0:7101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1784403397.419231:0:7101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72f04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+5:2357:x1871082240973184:12345-192.168.204.28@tcp:9:umount.0 Request processed in 646us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403397.419240:0:7101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 73 00000020:00010000:3.0:1784403397.419422:0:8813:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c8a7303c000: total 0 00010000:00010000:3.0:1784403397.419458:0:8813:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c8a7303c000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1784403397.419519:0:8813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f86c24e4/0x6828175665afb00c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eca2 expref: 4 pid: 7099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403397.419569:0:8813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f472cc9/0x6828175665afb6aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee70 expref: 3 pid: 7099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403397.419583:0:8813:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c8a7303c000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1784403397.419596:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403397.419599:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403397.419600:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784403397.420162:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403397.427187:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403397.427447:0:10011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240974208 00000100:00100000:2.0:1784403397.427458:0:10011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240974208 00000100:00100000:2.0:1784403397.427518:0:10011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 240 00000100:00100000:2.0:1784403397.427538:0:10011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+22:2357:x1871082240974208:12345-192.168.204.28@tcp:39:umount.0 00000020:00000080:2.0:1784403397.427573:0:10011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa6a4 00000020:00010000:2.0:1784403397.427645:0:10011:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c8a72e4a800: total 0 00000100:00080000:2.0:1784403397.427650:0:10011:0:(import.c:65:import_set_state_nolock()) ffff8c8a72e4e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784403397.427687:0:10011:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1784403397.428222:0:6279:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c8a72e4a800: total 0 00010000:00010000:0.0:1784403397.428281:0:6279:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c8a72e4a800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784403397.428376:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403397.428393:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784403397.428403:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afa9de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eaf7 expref: 21 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428451:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:0.0:1784403397.428454:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784403397.428458:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a40031200/0x6828175665afb58b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee23 expref: 20 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428475:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:0.0:1784403397.428477:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784403397.428480:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6400/0x6828175665afb08a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecc5 expref: 19 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428493:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:0.0:1784403397.428495:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784403397.428499:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7c00/0x6828175665afaeed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec55 expref: 18 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428511:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a51bd0e00) 00010000:00010000:0.0:1784403397.428514:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403397.428517:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe400/0x6828175665afa98a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eae2 expref: 17 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428547:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:0.0:1784403397.428550:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403397.428554:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afafcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec8d expref: 16 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428579:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:0.0:1784403397.428581:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403397.428585:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afb66b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee5b expref: 15 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428598:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:0.0:1784403397.428600:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403397.428604:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4600/0x6828175665afb06e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ecbe expref: 14 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428615:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c8a43245a00) 00010000:00010000:0.0:1784403397.428617:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784403397.428621:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce6200/0x6828175665afb695 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee69 expref: 13 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428641:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c8a4884dd00) 00010000:00010000:0.0:1784403397.428644:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784403397.428647:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5200/0x6828175665afaccb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ebc9 expref: 12 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428659:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c8a51bd0200) 00010000:00010000:0.0:1784403397.428662:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403397.428665:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a414fe800/0x6828175665afa96e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eadb expref: 11 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428679:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c8a51bd0d00) 00010000:00010000:0.0:1784403397.428681:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784403397.428691:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2200/0x6828175665afaff7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ec9b expref: 10 pid: 10011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428707:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c8a43245900) 00010000:00010000:0.0:1784403397.428710:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784403397.428713:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3400/0x6828175665afb369 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ed97 expref: 9 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403397.428726:0:6279:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c8a72e4a800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1784403397.428739:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403397.428742:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403397.428743:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403397.429830:0:10011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:becd6ccb-dd35-46e6-9ecf-44ee31a105f1+7:2357:x1871082240974208:12345-192.168.204.28@tcp:39:umount.0 Request processed in 2296us (2645us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1784403397.429843:0:10011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 240 00010000:00010000:2.0:1784403397.471079:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403398.203655:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403398.203917:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403398.204118:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240974464 00000100:00100000:2.0:1784403398.204129:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240974464 00000100:00100000:2.0:1784403398.204217:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00100000:2.0:1784403398.204228:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2360:x1871082240974464:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403398.204306:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2360:x1871082240974464:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 80us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403398.204313:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00080000:1.0:1784403398.205675:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403398.207974:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240974336 00000100:00100000:3.0:1784403398.208009:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240974336 00000100:00100000:3.0:1784403398.208150:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 307 00000100:00100000:3.0:1784403398.208163:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240974336:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1784403398.208261:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2360:x1871082240974336:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 100us (4618us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403398.208269:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 307 00010000:00010000:3.0:1784403398.496685:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403398.885469:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260877696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784403398.885558:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403398.885776:0:7104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260877696 00000100:00100000:0.0:1784403398.885785:0:7104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260877696 00000100:00100000:0.0:1784403398.885858:0:7104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784403398.885887:0:7104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260877696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784403398.885929:0:7104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784403398.885988:0:7104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260877696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403398.885995:0:7104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1784403398.890900:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403398.890982:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260877696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403399.389309:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403399.389357:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403399.389454:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403399.389550:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240974720 00000100:00100000:3.0:1784403399.389561:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240974720 00000100:00100000:3.0:1784403399.389621:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240974592 00000100:00100000:3.0:1784403399.389625:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240974592 00000100:00100000:3.0:1784403399.389637:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240974848 00000100:00100000:3.0:1784403399.389639:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240974848 00000100:00100000:3.0:1784403399.389654:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:3.0:1784403399.389663:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+12:2361:x1871082240974720:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403399.389680:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403399.389770:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41671200/0x6828175665afa77d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea41 expref: 12 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403399.389791:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403399.389862:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+11:2361:x1871082240974720:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 198us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403399.389920:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:3.0:1784403399.389940:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:3.0:1784403399.389948:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+10:2361:x1871082240974592:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403399.389957:0:6277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403399.389967:0:6277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7b5b2000/0x6828175665afa776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea17 expref: 10 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403399.389990:0:6277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403399.390025:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+9:2361:x1871082240974592:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 77us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403399.390031:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:2.0:1784403399.390235:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:2.0:1784403399.390247:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+8:2360:x1871082240974848:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403399.390257:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403399.390271:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7b5b2e00/0x6828175665afa913 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eac6 expref: 8 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403399.390288:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403399.390319:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+7:2360:x1871082240974848:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 76us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403399.390326:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1784403399.394513:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403399.394916:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240975104 00000100:00100000:3.0:1784403399.394928:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240975104 00000100:00100000:3.0:1784403399.394986:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 241 00000100:00100000:3.0:1784403399.394997:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+6:2357:x1871082240975104:12345-192.168.204.28@tcp:39:umount.0 00000020:00000080:3.0:1784403399.395041:0:6294:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa78b 00000020:00010000:3.0:1784403399.395051:0:6294:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c8a736a4800: total 0 00000100:00080000:3.0:1784403399.395056:0:6294:0:(import.c:65:import_set_state_nolock()) ffff8c8a522c6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784403399.395086:0:6294:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1784403399.395326:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e673c1a5-a199-4481-8204-90c8d9cfec2f+5:2357:x1871082240975104:12345-192.168.204.28@tcp:39:umount.0 Request processed in 330us (833us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1784403399.395335:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 241 00000020:00010000:0.0:1784403399.395427:0:6279:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c8a736a4800: total 0 00010000:00010000:0.0:1784403399.395432:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403399.395475:0:6279:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c8a736a4800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784403399.395523:0:6279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884de00) 00010000:00010000:0.0:1784403399.395541:0:6279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403399.395551:0:6279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afb6b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee77 expref: 4 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403399.395574:0:6279:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c8a736a4800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1784403399.395586:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403399.395588:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403399.395590:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403399.411678:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403399.411837:0:6285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240975360 00000100:00100000:2.0:1784403399.411848:0:6285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240975360 00000100:00100000:2.0:1784403399.411943:0:6285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 308 00000100:00100000:2.0:1784403399.411953:0:6285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+7:2357:x1871082240975360:12345-192.168.204.28@tcp:251:umount.0 00000020:00000080:2.0:1784403399.412004:0:6285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa681 00000020:00010000:2.0:1784403399.412012:0:6285:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c8a77cf3800: total 0 00000100:00080000:2.0:1784403399.412017:0:6285:0:(import.c:65:import_set_state_nolock()) ffff8c8a77cf5000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784403399.412106:0:6285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19cbaa0a-7e67-4763-bd2a-e7951d0c18e7+3:2357:x1871082240975360:12345-192.168.204.28@tcp:251:umount.0 Request processed in 154us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403399.412114:0:6285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 308 00000020:00010000:3.0:1784403399.412226:0:6280:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c8a77cf3800: total 0 00010000:00010000:3.0:1784403399.412290:0:6280:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c8a77cf3800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784403399.412322:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce4e00/0x6828175665afa737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ea09 expref: 2 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403399.412337:0:6280:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c8a77cf3800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1784403399.412348:0:6280:0:(genops.c:885:class_export_put()) final put ffff8c8a77cf3800/19cbaa0a-7e67-4763-bd2a-e7951d0c18e7 00010000:00010000:3.0:1784403399.412365:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403399.412367:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403399.412369:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784403399.413026:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a77cf3800/19cbaa0a-7e67-4763-bd2a-e7951d0c18e7 for MGS 00000020:00000080:2.0:1784403399.413066:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a77cf5000 for MGS 00010000:00010000:3.0:1784403399.519121:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403400.543080:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403400.932618:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260878080:0@lo:400:kworker.0 00000100:00100000:2.0:1784403400.932692:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403400.932754:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403400.932762:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260878208:0@lo:400:kworker.0 00000100:00100000:0.0:1784403400.932939:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260877824:0@lo:400:kworker.0 00000100:00100000:2.0:1784403400.933707:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403400.933731:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403400.933765:0:6293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260878080 00000100:00100000:2.0:1784403400.933773:0:6293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260878080 00000100:00100000:3.0:1784403400.933781:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260878208 00000100:00100000:3.0:1784403400.933793:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260878208 00000100:00100000:2.0:1784403400.933840:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784403400.933842:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784403400.933854:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260878208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403400.933938:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260878208:12345-0@lo:400:kworker.0 Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403400.933945:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784403400.933970:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260878080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403400.933995:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260878208:0@lo:400:kworker.0 00000100:00100000:0.0:1784403400.934112:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260878336:0@lo:400:kworker.0 00000100:00100000:0.0:1784403400.934145:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403400.934174:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784403400.934182:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260877952:0@lo:400:kworker.0 00000100:00100000:0.0:1784403400.934205:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403400.934225:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260878464:0@lo:400:kworker.0 00000100:00100000:3.0:1784403400.934288:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260878336 00000100:00100000:3.0:1784403400.934292:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260878336 00000100:00100000:3.0:1784403400.934311:0:6294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260877952 00000100:00100000:3.0:1784403400.934313:0:6294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260877952 00000100:00100000:3.0:1784403400.934326:0:6294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784403400.934332:0:6294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260878336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403400.934378:0:6287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260877824 00000100:00100000:1.0:1784403400.934382:0:6287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260877824 00000100:00100000:1.0:1784403400.934413:0:6287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1784403400.934420:0:6287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260877824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403400.934459:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403400.934479:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260878080:12345-0@lo:400:kworker.0 Request processed in 627us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403400.934487:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784403400.934510:0:6293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784403400.934517:0:6293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260877952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403400.934556:0:6294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3565:x1871082260878336:12345-0@lo:400:kworker.0 Request processed in 222us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403400.934564:0:6293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a58092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260877952:12345-0@lo:400:kworker.0 Request processed in 46us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403400.934640:0:8571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260878464 00000100:00100000:0.0:1784403400.934644:0:8571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260878464 00000100:00100000:0.0:1784403400.934673:0:8571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784403400.934680:0:8571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260878464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403400.934713:0:8571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260878464:12345-0@lo:400:kworker.0 Request processed in 34us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403400.934719:0:8571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784403400.934743:0:6287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64472369-fee1-4bb4-a407-7797860a37a0+19:3565:x1871082260877824:12345-0@lo:400:kworker.0 Request processed in 196us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403400.934750:0:6287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:1.0:1784403400.934777:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784403400.934782:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784403400.934792:0:6288:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403400.934829:0:6294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784403400.934859:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260878080:0@lo:400:kworker.0 00000100:00100000:1.0:1784403400.934921:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260877952:0@lo:400:kworker.0 00000100:00100000:1.0:1784403400.934931:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260878464:0@lo:400:kworker.0 00000100:00100000:1.0:1784403400.934938:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260877824:0@lo:400:kworker.0 00000100:00100000:1.0:1784403400.934946:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260878336:0@lo:400:kworker.0 00000100:00100000:2.0:1784403400.935660:0:6293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000020:01000004:2.0:1784403401.094112:0:13437:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784403401.113807:0:13437:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1784403401.114034:0:13437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403401.114062:0:13437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403401.114068:0:13437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403401.114074:0:13437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403401.114143:0:13437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784403401.114148:0:13437:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784403401.114176:0:13437:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784403401.114180:0:13437:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784403401.114185:0:13437:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784403401.114211:0:13437:0:(import.c:65:import_set_state_nolock()) ffff8c8a73923000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784403401.114286:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3564:1871082260878592:0@lo:39:umount.0 00000100:00100000:1.0:1784403401.114357:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403401.114480:0:6292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260878592 00000100:00100000:0.0:1784403401.114487:0:6292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260878592 00000100:00100000:0.0:1784403401.114543:0:6292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784403401.114552:0:6292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3564:x1871082260878592:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784403401.114579:0:6292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa490 00000100:00080000:0.0:1784403401.114585:0:6292:0:(import.c:65:import_set_state_nolock()) ffff8c8a52331800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784403401.114639:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403401.114647:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.114655:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7a00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403401.114658:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.114667:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403401.114684:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403401.114690:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784403401.114693:0:6280:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784403401.114696:0:6280:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784403401.114721:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.114728:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784403401.114777:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1784403401.114836:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.114852:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afa706 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa70d expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.114883:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403401.114886:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403401.114888:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403401.114991:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260878720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784403401.115031:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784403401.115235:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403401.115269:0:6292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3564:x1871082260878592:12345-0@lo:39:umount.0 Request processed in 717us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403401.115277:0:6292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1784403401.115287:0:6292:0:(genops.c:885:class_export_put()) final put ffff8c8a52336000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784403401.115347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a52336000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784403401.115398:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a52331800 for lustre-MDT0000 00000100:00100000:1.0:1784403401.115453:0:6276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260878720 00000100:00100000:1.0:1784403401.115469:0:6276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260878720 00000100:00100000:1.0:1784403401.115513:0:6276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784403401.115522:0:6276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a42ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+19:3568:x1871082260878720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403401.115533:0:6276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403401.115548:0:6276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afa70d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa706 expref: 19 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.115560:0:6276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403401.115601:0:6276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a42ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64472369-fee1-4bb4-a407-7797860a37a0+18:3568:x1871082260878720:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403401.115608:0:6276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784403401.115705:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260878720:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1784403401.115782:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a73923000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784403401.115831:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3564:1871082260878592:0@lo:39:umount.0 00000100:00080000:0.0:1784403401.116240:0:13437:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784403401.116254:0:13437:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784403401.116259:0:13437:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784403401.119189:0:13437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.119207:0:13437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.119214:0:13437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.119234:0:13437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.119251:0:13437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784403401.119446:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784403401.119454:0:6279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403401.119487:0:6279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3c00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:2.0:1784403401.119492:0:6279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403401.119501:0:6279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784403401.119509:0:6279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403401.119527:0:6279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784403401.119530:0:6279:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1784403401.119570:0:6279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403401.119576:0:6279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784403401.119616:0:6279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403401.119628:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403401.119630:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403401.119632:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403401.119643:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403401.119662:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260878848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784403401.119731:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403401.119789:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260878848 00000100:00100000:2.0:1784403401.119795:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260878848 00000100:00100000:2.0:1784403401.119839:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784403401.119860:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7744a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64472369-fee1-4bb4-a407-7797860a37a0+18:3567:x1871082260878848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784403401.119905:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403401.119921:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a40030600/0x6828175665afa71b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa714 expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403401.119935:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403401.119970:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7744a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64472369-fee1-4bb4-a407-7797860a37a0+17:3567:x1871082260878848:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403401.119977:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784403401.120020:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260878848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403401.120447:0:13437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3c00/0x6828175665afa714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa71b expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.120474:0:13437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.120482:0:13437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.120489:0:13437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.120496:0:13437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.120750:0:13437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403401.120759:0:13437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.120767:0:13437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.120773:0:13437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.120792:0:13437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.121008:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784403401.121015:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.121023:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7600 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403401.121027:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.121052:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403401.121059:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403401.121065:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784403401.121068:0:6280:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784403401.121071:0:6280:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784403401.121095:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.121101:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403401.121135:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.121143:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afa63b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa642 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.121157:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403401.121160:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.121166:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7000 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403401.121170:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.121177:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403401.121194:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403401.121200:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784403401.121202:0:6280:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1784403401.121216:0:6280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.121223:0:6280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403401.121229:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.121237:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403401.121239:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403401.121241:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403401.121336:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260878976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784403401.121500:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403401.121547:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784403401.121554:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260879104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784403401.121575:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403401.121635:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260878976 00000100:00100000:2.0:1784403401.121642:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260878976 00000100:00100000:2.0:1784403401.121684:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260879104 00000100:00100000:2.0:1784403401.121687:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260879104 00000100:00100000:2.0:1784403401.121705:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784403401.121713:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64472369-fee1-4bb4-a407-7797860a37a0+18:3565:x1871082260878976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784403401.121724:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403401.121736:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce7800/0x6828175665afa642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa63b expref: 18 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403401.121748:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403401.121782:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64472369-fee1-4bb4-a407-7797860a37a0+17:3565:x1871082260878976:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403401.121789:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784403401.121805:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784403401.121811:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64472369-fee1-4bb4-a407-7797860a37a0+16:3565:x1871082260879104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784403401.121819:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403401.121827:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41670800/0x6828175665afa944 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa93d expref: 16 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403401.121837:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403401.121896:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64472369-fee1-4bb4-a407-7797860a37a0+15:3565:x1871082260879104:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403401.121901:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784403401.121934:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260879104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784403401.121943:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64472369-fee1-4bb4-a407-7797860a37a0:3565:1871082260878976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403401.122199:0:13437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784403401.122206:0:13437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7000/0x6828175665afa93d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa944 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403401.122217:0:13437:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784403401.122225:0:13437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.122233:0:13437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.122239:0:13437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403401.122246:0:13437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.122341:0:8813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403401.122414:0:8813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.122422:0:8813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ffa00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403401.122425:0:8813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.122433:0:8813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403401.122439:0:8813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403401.122445:0:8813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784403401.122456:0:8813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1784403401.122484:0:8813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.122492:0:8813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403401.122520:0:8813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.122530:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403401.122532:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403401.122534:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403401.122572:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784403401.122583:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260879232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784403401.122631:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403401.122705:0:6278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260879232 00000100:00100000:3.0:1784403401.122711:0:6278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260879232 00000100:00100000:3.0:1784403401.122749:0:6278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784403401.122757:0:6278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943275180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64472369-fee1-4bb4-a407-7797860a37a0+15:3568:x1871082260879232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403401.122767:0:6278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403401.122777:0:6278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a5b67a600/0x6828175665afa3f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa3ef expref: 15 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403401.122791:0:6278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403401.122824:0:6278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943275180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64472369-fee1-4bb4-a407-7797860a37a0+14:3568:x1871082260879232:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403401.122830:0:6278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784403401.122989:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260879232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403401.123110:0:13437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784403401.123117:0:13437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a414ffa00/0x6828175665afa3ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa3f6 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403401.123131:0:13437:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1784403401.123136:0:13437:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1784403401.123138:0:13437:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1784403401.123165:0:13437:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1784403401.123169:0:13437:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1784403401.123179:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784403401.123184:0:13437:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1784403401.123189:0:13437:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c8a43032800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784403401.123195:0:13437:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c8a75f93000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784403401.123203:0:13437:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c8a736a4800 e673c1a5-a199-4481-8204-90c8d9cfec2f 192.168.204.28@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784403401.123209:0:13437:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c8a72e4a800 becd6ccb-dd35-46e6-9ecf-44ee31a105f1 192.168.204.28@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:1.0:1784403401.123213:0:13437:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8c8a452b4d40) has exports, disconnecting them 00000020:00080000:1.0:1784403401.123218:0:13437:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c8a43032800), last request at 1784403400 00000020:00000080:1.0:1784403401.123224:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa603 00000100:00080000:1.0:1784403401.123238:0:13437:0:(import.c:65:import_set_state_nolock()) ffff8c8a77cf1000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784403401.123331:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784403401.123508:0:13437:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c8a43032800): rc 0 00000020:00000080:1.0:1784403401.123511:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a43032800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1784403401.123528:0:13437:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c8a75f93000), last request at 1784403400 00000020:00000080:1.0:1784403401.123532:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa538 00000100:00080000:1.0:1784403401.123538:0:13437:0:(import.c:65:import_set_state_nolock()) ffff8c8a75f92000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784403401.123568:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a43032800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784403401.123620:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a77cf1000 for lustre-MDT0000 00010000:00010000:3.0:1784403401.123680:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784403401.123739:0:13437:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c8a75f93000): rc 0 00000020:00000080:1.0:1784403401.123742:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a75f93000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1784403401.123757:0:13437:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb3f142bf3ae0 00000100:00080000:1.0:1784403401.123779:0:13437:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784403401.123783:0:13437:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1784403401.123803:0:13437:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784403401.123906:0:13437:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1784403401.123924:0:13437:0:(import.c:65:import_set_state_nolock()) ffff8c8a7ddc5800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784403401.123939:0:13437:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784403401.123941:0:13437:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1784403401.123950:0:13437:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784403401.124019:0:13437:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784403401.124035:0:13437:0:(import.c:65:import_set_state_nolock()) ffff8c8a453ba800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1784403401.124064:0:13437:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c8a452b4d40) has no exports 00000020:00000080:2.0:1784403401.124225:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a75f93000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784403401.124373:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a75f92000 for lustre-MDT0000 00000100:00100000:2.0:1784403401.124389:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260879360:0@lo:9:umount.0 00000100:00100000:2.0:1784403401.124440:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403401.124483:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260879488:0@lo:9:umount.0 00000100:00100000:2.0:1784403401.124506:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403401.124660:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260879360 00000100:00100000:0.0:1784403401.124667:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260879360 00000100:00100000:0.0:1784403401.124707:0:7099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260879488 00000100:00100000:0.0:1784403401.124710:0:7099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260879488 00000100:00100000:0.0:1784403401.124734:0:7099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784403401.124742:0:7099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3564:x1871082260879360:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784403401.124767:0:7099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa585 00000100:00080000:0.0:1784403401.124774:0:7099:0:(import.c:65:import_set_state_nolock()) ffff8c8a736a0000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784403401.124812:0:7102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784403401.124820:0:7102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7744aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3564:x1871082260879488:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784403401.124833:0:7102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa66c 00000100:00080000:1.0:1784403401.124839:0:7102:0:(import.c:65:import_set_state_nolock()) ffff8c8a72e4d000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784403401.125004:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784403401.125671:0:7099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:2.0:1784403401.126067:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403401.126133:0:7099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3564:x1871082260879360:12345-0@lo:9:umount.0 Request processed in 1389us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403401.126143:0:7099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1784403401.126225:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a7ddc5800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784403401.126244:0:3564:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784403401.126247:0:3564:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784403401.126250:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260879360:0@lo:9:umount.0 00000001:00000004:1.0:1784403401.126506:0:7102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1784403401.126659:0:7102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7744aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3564:x1871082260879488:12345-0@lo:9:umount.0 Request processed in 1838us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403401.126666:0:7102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1784403401.126714:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784403401.126760:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a453ba800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784403401.126779:0:3564:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784403401.126781:0:3564:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784403401.126785:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260879488:0@lo:9:umount.0 00000020:00080000:1.0:1784403401.133909:0:13437:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c8a452b4d40) has no exports 00000020:00000080:1.0:1784403401.178109:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa44a 00000020:00000080:1.0:1784403401.178123:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a73a31000/lustre-QMT0000_UUID 00000020:01000000:1.0:1784403401.178175:0:13437:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1784403401.178242:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784403401.178253:0:13437:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784403401.178257:0:13437:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8c8a526fb380) has no exports 00000020:00000080:0.0:1784403401.178553:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa443 00000020:00000080:0.0:1784403401.178559:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a7cf50000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784403401.178587:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a73a31000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784403401.178672:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7cf50000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784403401.178744:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784403401.178752:0:13437:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784403401.178755:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a7cf52800/lustre-QMT0000_UUID 00000020:00000080:0.0:1784403401.178758:0:13437:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7cf52800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784403401.178765:0:13437:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00080000:3.0:1784403401.494834:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1784403401.494851:0:6314:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000001:00080000:3.0:1784403401.494856:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1784403401.494897:0:6314:0:(genops.c:885:class_export_put()) final put ffff8c8a72e4a800/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000001:00100000:3.0:1784403401.494914:0:6314:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e673c1a5-a199-4481-8204-90c8d9cfec2f 00000001:00080000:3.0:1784403401.494920:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1784403401.494922:0:6314:0:(genops.c:885:class_export_put()) final put ffff8c8a736a4800/e673c1a5-a199-4481-8204-90c8d9cfec2f 00000020:00000080:3.0:1784403401.494935:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a72e4a800/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 for lustre-MDT0000 00000020:00000080:3.0:1784403401.494991:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a736a4800/e673c1a5-a199-4481-8204-90c8d9cfec2f for lustre-MDT0000 00000020:00000080:3.0:1784403401.495013:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a72e4e800 for lustre-MDT0000 00000020:00000080:3.0:1784403401.495017:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a522c6800 for lustre-MDT0000 00000001:00100000:2.0:1784403401.522146:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784403401.522161:0:7124:0:(genops.c:885:class_export_put()) final put ffff8c8a736a6000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1784403401.522195:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000020:00000080:2.0:1784403401.522198:0:7124:0:(genops.c:885:class_export_put()) final put ffff8c8a7303c000/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000020:00000080:0.0:1784403401.522464:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a736a6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784403401.522521:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7303c000/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 for lustre-OST0000 00000020:00000080:0.0:1784403401.522544:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a736a0000 for lustre-OST0000 00000020:00000080:0.0:1784403401.522549:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a7303a800 for lustre-OST0000 00010000:00010000:3.0:1784403401.567086:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784403402.001166:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784403402.001174:0:8006:0:(genops.c:885:class_export_put()) final put ffff8c8a72e4e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784403402.001491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a72e4e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784403402.001541:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a72e4d000 for lustre-OST0001 00000001:00100000:1.0:1784403402.001842:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000020:00000080:1.0:1784403402.001847:0:8006:0:(genops.c:885:class_export_put()) final put ffff8c8a7b609800/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 00000020:00000080:0.0:1784403402.002003:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7b609800/becd6ccb-dd35-46e6-9ecf-44ee31a105f1 for lustre-OST0001 00000020:00000080:0.0:1784403402.002092:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a7b608800 for lustre-OST0001 00010000:00010000:2.0:1784403402.591430:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1784403403.232164:0:13437:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c8a7b5be5a0 - data ffff8c8a77ac5bd0/ffff8c8a77607000 00000020:01000000:0.0:1784403403.232315:0:13437:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c8a5872cc60 - data ffff8c8a50884870/ffff8c8a49ce1800 00000001:00000004:0.0:1784403403.243369:0:13437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1784403403.345365:0:13437:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784403403.345375:0:13437:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1784403403.345395:0:13437:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784403403.345398:0:13437:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784403403.350843:0:7279:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784403403.350852:0:7279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1784403403.350888:0:7279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1784403403.357637:0:13437:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784403403.357648:0:13437:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1784403403.358592:0:13437:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784403403.358607:0:13437:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784403403.361122:0:8233:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784403403.361131:0:8233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1784403403.361146:0:8233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1784403403.432220:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa412 00000020:00000080:2.0:1784403403.432233:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a73926800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784403403.432490:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a73926800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784403403.437769:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa427 00000020:00000080:3.0:1784403403.437787:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a73908800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784403403.437840:0:13437:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784403403.437847:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784403403.437856:0:13437:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784403403.437861:0:13437:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8c8a452b3380) has no exports 00000004:01000000:3.0:1784403403.438184:0:13437:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784403403.438204:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa665 00000020:00000080:3.0:1784403403.438209:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a77cf2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784403403.438390:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a73908800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784403403.438466:0:13437:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784403403.438472:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784403403.438480:0:13437:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784403403.438483:0:13437:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8c8a527a19c0) has no exports 00000020:00000080:3.0:1784403403.438492:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa65e 00000020:00000080:3.0:1784403403.438497:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a77cf1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784403403.438521:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a77cf2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784403403.438656:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a77cf1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784403403.441451:0:13437:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784403403.441460:0:13437:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784403403.441464:0:13437:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1784403403.441472:0:13437:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784403403.441488:0:13437:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784403403.441581:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784403403.441596:0:13437:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784403403.441609:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa57e 00000020:00000080:3.0:1784403403.441619:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a7ddc4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784403403.441648:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a453ba800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784403403.441657:0:36:0:(genops.c:885:class_export_put()) final put ffff8c8a77cf0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784403403.441660:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a77cf0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784403403.441667:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784403403.441806:0:13437:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784403403.441812:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784403403.441818:0:13437:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784403403.441822:0:13437:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8c8a58098000) has no exports 00000020:00000080:3.0:1784403403.441828:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa577 00000020:00000080:3.0:1784403403.441833:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a7ddc6800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784403403.441855:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7ddc4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1784403403.442484:0:13437:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784403403.442488:0:13437:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784403403.442491:0:13437:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1784403403.442495:0:13437:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784403403.442497:0:13437:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784403403.442588:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7ddc6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784403403.442673:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784403403.442680:0:13437:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784403403.442709:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784403403.442712:0:13437:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784403403.442716:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a73920000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784403403.442719:0:13437:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a73920000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784403403.442724:0:13437:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784403403.442912:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa42e 00000020:00000080:3.0:1784403403.442918:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a7390d000/lustre-MDD0000_UUID 00000020:00000080:0.0:1784403403.443044:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a7ddc5800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784403403.443051:0:36:0:(genops.c:885:class_export_put()) final put ffff8c8a7ddc5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784403403.443054:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7ddc5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784403403.443058:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784403403.443268:0:13437:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1784403403.443273:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784403403.443279:0:13437:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784403403.443282:0:13437:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8c8a452b19c0) has no exports 00000020:00000080:3.0:1784403403.443304:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784403403.443307:0:13437:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1784403403.443312:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa435 00000020:00000080:3.0:1784403403.443325:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a7390e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784403403.443351:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7390d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784403403.443356:0:36:0:(genops.c:885:class_export_put()) final put ffff8c8a73922800/lustre-MDD0000_UUID 00000020:00000080:0.0:1784403403.443358:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a73922800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784403403.443362:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1784403403.443634:0:13437:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c8a5270b000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1784403403.443638:0:13437:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a5270b000 3 00000020:01000004:3.0:1784403403.443643:0:13437:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c8a5270b000 from lustre-MDT0000 00000020:00000080:3.0:1784403403.443675:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784403403.443679:0:13437:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1784403403.443683:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a73925800/lustre-MDT0000_UUID 00000020:00000080:3.0:1784403403.443685:0:13437:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a73925800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1784403403.443692:0:13437:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1784403403.443723:0:13437:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1784403403.443728:0:13437:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1784403403.443731:0:13437:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1784403403.443734:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784403403.443736:0:13437:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784403403.443743:0:13437:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8c8a4891d800 64472369-fee1-4bb4-a407-7797860a37a0 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784403403.443749:0:13437:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8c8a526f99c0) has exports, disconnecting them 00000020:00080000:3.0:1784403403.443753:0:13437:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c8a4891d800), last request at 1784403165 00000020:00000080:3.0:1784403403.443766:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa3d3 00000020:00010000:3.0:1784403403.443770:0:13437:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c8a4891d800: total 1 00000100:00080000:3.0:1784403403.443774:0:13437:0:(import.c:65:import_set_state_nolock()) ffff8c8a48919000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784403403.443789:0:13437:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c8a4891d800): rc 0 00000020:00080000:3.0:1784403403.443792:0:13437:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8c8a526f99c0) has no exports 00000100:00100000:3.0:1784403403.443909:0:6286:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c8a49d24c00:6286] 1 exiting: rc = 0 00000100:00100000:1.0:1784403403.443920:0:6287:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c8a49d20600:6287] 2 exiting: rc = 0 00000100:00100000:1.0:1784403403.444006:0:6285:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c8a49d21000:6285] 0 exiting: rc = 1 00000100:00100000:1.0:1784403403.444077:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444087:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:2.0:1784403403.444093:0:6280:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c8a4891d800: total 1 00000100:00100000:1.0:1784403403.444096:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444105:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444111:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444117:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444125:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444136:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784403403.444137:0:6280:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c8a4891d800, canceled 0 locks, left on hash table 8. 00000100:00100000:1.0:1784403403.444145:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444152:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784403403.444167:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41671e00/0x6828175665afa4eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa4e4 expref: 9 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403403.444171:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444181:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444192:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784403403.444207:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6000/0x6828175665afa6d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa6ce expref: 8 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403403.444217:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784403403.444230:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7b5b2c00/0x6828175665afa6e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa6dc expref: 7 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403403.444241:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41670e00/0x6828175665afa6f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa6ea expref: 6 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403403.444251:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a41670600/0x6828175665afa6ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa6f8 expref: 5 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403403.444261:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6e00/0x6828175665afa729 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa722 expref: 4 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403403.444272:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afa928 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa921 expref: 3 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403403.444282:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce7200/0x6828175665afa936 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6828175665afa92f expref: 2 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403403.444305:0:6280:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c8a4891d800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1784403403.444319:0:6280:0:(genops.c:885:class_export_put()) final put ffff8c8a4891d800/64472369-fee1-4bb4-a407-7797860a37a0 00000100:00100000:1.0:1784403403.444347:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444355:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444362:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444370:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444375:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444381:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444388:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444395:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444401:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444408:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444426:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444436:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784403403.444439:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7390e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1784403403.444446:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444454:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444461:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444467:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444474:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444480:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444487:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444494:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444501:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784403403.444508:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403403.444509:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784403403.444511:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403403.444515:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403403.444520:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444527:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444533:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444539:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784403403.444540:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a4891d800/64472369-fee1-4bb4-a407-7797860a37a0 for MGS 00000100:00100000:1.0:1784403403.444547:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444555:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444561:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444568:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444575:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444591:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444600:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444607:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444614:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444622:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444628:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444635:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784403403.444636:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a48919000 for MGS 00000100:00100000:1.0:1784403403.444644:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444652:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444658:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444664:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444670:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444889:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444899:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444907:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444913:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444919:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444927:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.444933:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1784403403.445511:0:13437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784403403.445515:0:13437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1784403403.450410:0:13437:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c8a49cda4e0 - data ffff8c8a508865e8/ffff8c8a7b59c800 00000020:01000000:2.0:1784403403.450532:0:13437:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c8a49ffcc60 - data ffff8c8a5084de58/ffff8c8a65f8ec00 00000020:00000080:2.0:1784403403.451053:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa3b7 00000020:00000080:2.0:1784403403.451061:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a52708800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784403403.451079:0:13437:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c8a5270b000 from MGS, refs=2 00000020:01000004:2.0:1784403403.451082:0:13437:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a5270b000 2 00000020:01000004:2.0:1784403403.451086:0:13437:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c8a5270b000 from MGS 00000020:00000080:2.0:1784403403.451108:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784403403.451114:0:13437:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784403403.451117:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a5270d800/MGS 00000020:00000080:2.0:1784403403.451119:0:13437:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a5270d800/MGS for MGS 00000020:01000000:2.0:1784403403.451125:0:13437:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784403403.451180:0:13437:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784403403.451184:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784403403.451189:0:13437:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784403403.451208:0:13437:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c8a73925000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784403403.451214:0:13437:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8c8a452b0000) has exports, disconnecting them 00000020:00080000:2.0:1784403403.451219:0:13437:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c8a73925000), last request at 1784403166 00000020:00000080:2.0:1784403403.451222:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa482 00000020:00080000:2.0:1784403403.451229:0:13437:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c8a73925000): rc 0 00000020:00000080:2.0:1784403403.451234:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a73925000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784403403.451902:0:13437:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784403403.451907:0:13437:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784403403.451925:0:13437:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784403403.451930:0:13437:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784403403.452026:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784403403.452032:0:13437:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784403403.452037:0:13437:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a5270b000 1 00000020:00000080:2.0:1784403403.452041:0:13437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa3a9 00000020:00000080:2.0:1784403403.452045:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a5270f000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1784403403.452049:0:13437:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784403403.452052:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784403403.452055:0:13437:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784403403.452058:0:13437:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8c8a526fcd40) has no exports 00000020:00000080:3.0:1784403403.453012:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a52708800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784403403.453025:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a73925000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784403403.453031:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a73923000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784403403.453037:0:36:0:(genops.c:885:class_export_put()) final put ffff8c8a7390c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784403403.453040:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7390c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1784403403.453044:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1784403403.453104:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a5270f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784403403.513088:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784403403.513102:0:13437:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1784403403.513108:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a5270c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784403403.513113:0:13437:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a5270c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784403403.513124:0:13437:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1784403403.513256:0:13437:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c8a52709000 00000020:01000000:2.0:1784403403.513280:0:13437:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1784403403.513284:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784403403.513289:0:13437:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784403403.513293:0:13437:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8c8a5809cd40) has no exports 00000100:00100000:2.0:1784403403.513366:0:6293:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8c8a46ab5c00:6293] 1 exiting: rc = 0 00000100:00100000:2.0:1784403403.513481:0:10011:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8c8a49ce6000:10011] 3 exiting: rc = 0 00000100:00100000:3.0:1784403403.513616:0:6294:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8c8a49dfa600:6294] 2 exiting: rc = 0 00000100:00100000:0.0:1784403403.519721:0:6292:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8c8a580a3000:6292] 0 exiting: rc = 1 00000100:00100000:2.0:1784403403.522333:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522343:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522349:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522354:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522359:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522364:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522370:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522375:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522380:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522387:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522408:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522424:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522432:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522439:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522444:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522450:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522456:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522461:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522467:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522472:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522477:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522482:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522488:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522493:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522498:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522503:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522508:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522512:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522517:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522522:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522527:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522532:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522536:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522541:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522546:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522551:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522556:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522561:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522566:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522571:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522576:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522581:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522586:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522590:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522595:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522610:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522615:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522621:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522627:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522632:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522638:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522643:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522648:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522653:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522660:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522665:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522670:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522675:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522681:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522685:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522690:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522696:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522701:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.522707:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.535924:0:6296:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8c8a49dfba00:6296] 1 exiting: rc = 0 00000100:00100000:0.0:1784403403.536468:0:6295:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8c8a49dfb600:6295] 0 exiting: rc = 1 00000100:00100000:3.0:1784403403.536632:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536641:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536648:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536653:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536658:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536664:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536670:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536677:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536681:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536687:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536693:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536699:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536705:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536710:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536715:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536721:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536726:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536731:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536737:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536741:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536746:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536751:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536755:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536760:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536765:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536769:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.536856:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537005:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537015:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537020:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537026:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537033:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537038:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537042:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537061:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537066:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537071:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537077:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537082:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537087:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537091:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537097:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537102:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537107:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537112:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537117:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537122:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537128:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537134:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537140:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537146:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537152:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537157:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537163:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537169:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537174:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537178:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537183:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537188:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537254:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537261:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537266:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537272:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.537277:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538299:0:6298:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8c8a430a1e00:6298] 1 exiting: rc = 0 00000100:00100000:1.0:1784403403.538366:0:12944:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8c8a7753ac00:12944] 2 exiting: rc = 0 00000100:00100000:2.0:1784403403.538545:0:6297:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8c8a49d4a000:6297] 0 exiting: rc = 1 00000100:00100000:0.0:1784403403.538700:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538708:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538714:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538719:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538725:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538731:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538738:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538744:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538752:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538772:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538793:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538800:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538807:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538815:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538822:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538838:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538845:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538852:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538858:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538880:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538888:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538907:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538914:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538919:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538938:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538946:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538953:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538959:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538966:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538972:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538977:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538984:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.538990:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539010:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539018:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539024:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539030:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539037:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539044:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539049:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539055:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539062:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539069:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539075:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539081:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539104:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539110:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539116:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539124:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539129:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539143:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539148:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539154:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539163:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539168:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539173:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539179:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539215:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539222:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539228:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539235:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539241:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539247:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403403.539254:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.549468:0:6300:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8c8a430a1800:6300] 1 exiting: rc = 0 00000100:00100000:2.0:1784403403.549505:0:6299:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8c8a49d4aa00:6299] 0 exiting: rc = 1 00000100:00100000:1.0:1784403403.549619:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549627:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549632:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549638:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549643:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549650:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549658:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549666:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549672:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549678:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549683:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549688:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549707:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549711:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549716:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549721:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549725:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549730:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549735:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549740:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549745:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549750:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549755:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549759:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549764:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549769:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549850:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549860:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549921:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.549998:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550004:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550010:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550017:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550023:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550028:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550033:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550037:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550042:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550047:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550051:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550057:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550062:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550067:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550071:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550076:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550081:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550086:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550099:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550104:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550110:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550116:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550121:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550125:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550131:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550136:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550140:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550145:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550151:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550156:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550160:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550165:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550170:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550175:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.550181:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403403.550804:0:6302:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8c8a430a0800:6302] 1 exiting: rc = 0 00000100:00100000:3.0:1784403403.551449:0:6301:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8c8a49d50e00:6301] 0 exiting: rc = 1 00000100:00100000:1.0:1784403403.551558:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551565:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551570:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551576:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551582:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551588:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551593:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551599:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551604:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551609:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551614:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551619:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551624:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551628:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551633:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551637:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551641:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551646:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551661:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551666:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551671:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551676:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551681:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551686:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551691:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551696:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551701:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551706:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551710:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551715:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551719:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551724:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551728:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551732:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551737:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551742:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551747:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551752:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551757:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551762:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551767:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551772:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551848:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551853:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551858:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.551863:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552014:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552019:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552024:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552029:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552034:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552039:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552044:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552058:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552064:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552069:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552074:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552078:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552082:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552086:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552090:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552095:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552100:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.552105:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403403.552725:0:6303:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8c8a49d51400:6303] 0 exiting: rc = 1 00000100:00100000:0.0:1784403403.553336:0:6304:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8c8a430a1600:6304] 1 exiting: rc = 0 00000100:00100000:1.0:1784403403.553519:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553527:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553532:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553538:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553543:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553547:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553552:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553557:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553561:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553567:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553572:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553577:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553582:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553587:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553592:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553598:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553603:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553608:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553613:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553619:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553623:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553629:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553633:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553637:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553654:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553660:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553665:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553670:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553674:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553680:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553684:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553689:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553693:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553697:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553702:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553706:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553711:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553716:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553721:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553727:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553733:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553738:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553743:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553749:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553753:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553758:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553763:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553768:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553773:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553899:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553903:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553907:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553911:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553914:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553917:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.553921:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.554026:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.554034:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.554040:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.554053:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.554059:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.554064:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.554069:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.554075:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.554665:0:6307:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8c8a49d4f800:6307] 2 exiting: rc = 0 00000100:00100000:2.0:1784403403.555170:0:6305:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8c8a49d4e000:6305] 0 exiting: rc = 1 00000100:00100000:3.0:1784403403.555654:0:6306:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8c8a49d4fe00:6306] 1 exiting: rc = 0 00000100:00100000:1.0:1784403403.555712:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555719:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555725:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555731:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555740:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555749:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555755:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555761:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555767:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555774:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555780:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555786:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555791:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555796:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555801:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555807:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555812:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555836:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555845:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555851:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555857:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555862:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555887:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555894:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555899:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555904:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555911:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555918:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.555923:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556155:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556162:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556168:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556174:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556180:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556186:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556193:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556199:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556204:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556211:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556217:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556222:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556244:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556252:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556257:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556263:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556269:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556275:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556280:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556286:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556292:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556298:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556304:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556309:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556314:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556320:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556327:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556332:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556339:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556346:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556352:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556357:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556363:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556369:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403403.556374:0:13437:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784403403.564252:0:13437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784403403.564266:0:13437:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1784403403.564272:0:13437:0:(genops.c:885:class_export_put()) final put ffff8c8a58001000/MDS_uuid 00000020:00000080:0.0:1784403403.564277:0:13437:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a58001000/MDS_uuid for MDS 00000020:01000000:0.0:1784403403.564285:0:13437:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1784403403.564738:0:13437:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1784403403.616503:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403404.640626:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403405.663921:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403406.047169:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403406.047293:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260879744:0@lo:400:kworker.0 00000400:00000100:2.0:1784403406.047345:0:3565:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871082260879744 offset 0 length 224: 4 00000100:00100000:2.0:1784403406.047413:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784403406.047419:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260879872:0@lo:400:kworker.0 00000400:00000100:2.0:1784403406.047438:0:3565:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871082260879872 offset 0 length 224: 4 00000100:00100000:1.0:1784403406.049028:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260879616:0@lo:400:kworker.0 00000400:00000100:1.0:1784403406.049085:0:3567:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871082260879616 offset 0 length 224: 4 00000020:01000004:0.0:1784403406.216258:0:13594:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784403406.236965:0:13594:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1784403406.237014:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403406.237027:0:13594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403406.237034:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403406.237042:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403406.237078:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784403406.237084:0:13594:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1784403406.237087:0:8813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403406.237095:0:8813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403406.237104:0:8813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3a00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403406.237107:0:8813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403406.237116:0:8813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403406.237135:0:8813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403406.237141:0:8813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:0.0:1784403406.237181:0:13594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784403406.237193:0:13594:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c8a77448a80 x1871082260879744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403422 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784403406.237268:0:8813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784403406.237271:0:8813:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1784403406.237272:0:13594:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784403406.237279:0:13594:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784403406.237301:0:13594:0:(import.c:65:import_set_state_nolock()) ffff8c8a75f94000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1784403406.237304:0:8813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403406.237310:0:8813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403406.237327:0:8813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403406.237335:0:8813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3a00/0x6828175665afa6ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6828175665afa6f1 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403406.237340:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3564:1871082260880128:0@lo:39:umount.0 00010000:00010000:3.0:1784403406.237346:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403406.237348:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403406.237350:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403406.237357:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784403406.237379:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260880000:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1784403406.237406:0:3564:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871082260880128 offset 0 length 224: 4 00000100:00100000:1.0:1784403406.237843:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260879744:0@lo:400:kworker.0 00000100:00100000:3.0:1784403406.244819:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403406.245512:0:6277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260880000 00000100:00100000:0.0:1784403406.245522:0:6277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260880000 00000100:00100000:0.0:1784403406.245566:0:6277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784403406.245574:0:6277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3568:x1871082260880000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784403406.245689:0:6277:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784403406 with bad export cookie 7505274438853567443 00000100:00100000:0.0:1784403406.257186:0:6277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3568:x1871082260880000:12345-0@lo:103:ldlm_bl.0 Request processed in 11602us (12363us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784403406.257200:0:6277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1784403406.257302:0:3568:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.128@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784403406.257308:0:3568:0:(import.c:65:import_set_state_nolock()) ffff8c8a5270e000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1784403406.257311:0:3568:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.128@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1784403406.265924:0:3568:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.128@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1784403406.265930:0:3568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784403406.265942:0:3568:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c8a77448e00 x1871082260879616/t0(0) o400->MGC192.168.204.128@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784403422 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403406.265975:0:3568:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c8a73605500 x1871082260880000/t0(0) o103->MGC192.168.204.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784403422 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784403406.265985:0:3568:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784403406.265988:0:3568:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784403406.265990:0:3568:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784403406.265994:0:3568:0:(import.c:65:import_set_state_nolock()) ffff8c8a5270e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784403406.266000:0:3568:0:(import.c:510:import_select_connection()) MGC192.168.204.128@tcp: connect to NID 0@lo last attempt 170 00000100:00080000:3.0:1784403406.266009:0:3568:0:(import.c:624:import_select_connection()) MGC192.168.204.128@tcp: import ffff8c8a5270e000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1784403406.266152:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64472369-fee1-4bb4-a407-7797860a37a0:3567:1871082260879616:0@lo:400:kworker.0 00000100:00100000:2.0:1784403406.266544:0:3568:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a77449500 x1871082260880256/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784403406.266714:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64472369-fee1-4bb4-a407-7797860a37a0:3568:1871082260880000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784403406.266791:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64472369-fee1-4bb4-a407-7797860a37a0:3564:1871082260880256:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1784403406.266847:0:3564:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871082260880256 offset 0 length 520: 4 00010000:00010000:2.0:1784403406.687352:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403407.711076:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403408.735285:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403409.761463:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403410.785753:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784403411.168440:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 64472369-fee1-4bb4-a407-7797860a37a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784403411.168456:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 64472369-fee1-4bb4-a407-7797860a37a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784403411.168793:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260880384:0@lo:400:kworker.0 00000400:00000100:1.0:1784403411.168897:0:3568:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871082260880384 offset 0 length 224: 4 00010000:00010000:3.0:1784403411.807158:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403412.831159:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403413.857415:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403414.879737:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403415.905211:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784403416.287121:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 64472369-fee1-4bb4-a407-7797860a37a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784403416.287134:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 64472369-fee1-4bb4-a407-7797860a37a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784403416.287262:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260880512:0@lo:400:kworker.0 00000400:00000100:2.0:1784403416.287333:0:3565:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871082260880512 offset 0 length 224: 4 00000100:00100000:2.0:1784403416.799589:0:3564:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784403406/real 1784403406] req@ffff8c8a77449500 x1871082260880256/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784403416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403416.799629:0:3564:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c8a77449500 x1871082260880256/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784403416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403416.799641:0:3564:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784403406/real 1784403406] req@ffff8c8943275f80 x1871082260880128/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784403416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403416.799664:0:3564:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c8943275f80 x1871082260880128/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784403416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784403416.799686:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a5270e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784403416.799718:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1784403416.799722:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64472369-fee1-4bb4-a407-7797860a37a0:3564:1871082260880256:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1784403416.799761:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a75f94000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784403416.799775:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3564:1871082260880128:0@lo:39:umount.0 00000100:00080000:0.0:1784403416.799895:0:13594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784403416.799901:0:13594:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784403416.799906:0:13594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784403416.800830:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403416.800909:0:13594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403416.800918:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403416.800925:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403416.800954:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784403416.800963:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403416.800970:0:13594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403416.800976:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403416.800982:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403416.800995:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1784403416.800999:0:13594:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1784403416.801026:0:13594:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1784403416.801032:0:13594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1784403416.801037:0:13594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784403416.801044:0:13594:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784403416.801049:0:13594:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8c8a527a4d40) has no exports 00000020:00080000:0.0:1784403416.801092:0:13594:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8c8a527a4d40) has no exports 00000020:01000000:0.0:1784403416.802786:0:13594:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c8a6e4eb360 - data ffff8c8a709dd000/ffff8c8a7b5dec00 00000020:01000000:0.0:1784403416.803029:0:13594:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c8a45755f60 - data ffff8c8a5088dbd0/ffff8c8a775fec00 00010000:00010000:2.0:1784403416.805048:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784403416.805067:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403416.805082:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3800 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:2.0:1784403416.805087:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403416.805099:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784403416.805107:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403416.805113:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784403416.805116:0:6280:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1784403416.805120:0:6280:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1784403416.805146:0:6280:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c8a5270e000 00010000:00010000:2.0:1784403416.805150:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403416.805157:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3800/0x6828175665afa6f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa6ff expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403416.805183:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784403416.805188:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403416.805220:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6c00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:2.0:1784403416.805224:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403416.805231:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784403416.805237:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403416.805242:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784403416.805244:0:6280:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784403416.805246:0:6280:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784403416.805252:0:6280:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c8a5270e000 00010000:00010000:2.0:1784403416.805255:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403416.805261:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6c00/0x6828175665afa92f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa936 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403416.805269:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403416.805271:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403416.805272:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403416.807374:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784403416.807396:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 64472369-fee1-4bb4-a407-7797860a37a0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784403416.807404:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784403416.807409:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c8a5270e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784403416.807420:0:38:0:(import.c:510:import_select_connection()) MGC192.168.204.128@tcp: connect to NID 0@lo last attempt 411 00000100:00080000:3.0:1784403416.807427:0:38:0:(import.c:589:import_select_connection()) MGC192.168.204.128@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784403416.807435:0:38:0:(import.c:624:import_select_connection()) MGC192.168.204.128@tcp: import ffff8c8a5270e000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1784403416.807495:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a73604380 x1871082260880640/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784403416.807618:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260880768:0@lo:400:kworker.0 00000400:00000100:3.0:1784403416.807690:0:3566:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871082260880768 offset 0 length 224: 4 00000100:00100000:2.0:1784403416.808192:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64472369-fee1-4bb4-a407-7797860a37a0:3564:1871082260880640:0@lo:250:kworker.0 00000400:00000100:2.0:1784403416.808224:0:3564:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871082260880640 offset 0 length 520: 4 00100000:10000000:0.0:1784403416.827763:0:13594:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784403416.874697:0:13594:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa507 00000020:00000080:2.0:1784403416.874712:0:13594:0:(genops.c:885:class_export_put()) final put ffff8c8a7764d800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1784403416.874739:0:13594:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c8a43036800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1784403416.874762:0:13594:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a43036800 2 00000020:01000004:2.0:1784403416.874766:0:13594:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c8a43036800 from lustre-OST0000 00000020:00000080:2.0:1784403416.874823:0:13594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784403416.874837:0:13594:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1784403416.874841:0:13594:0:(genops.c:885:class_export_put()) final put ffff8c8a7764b000/lustre-OST0000_UUID 00000020:00000080:2.0:1784403416.874845:0:13594:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7764b000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1784403416.874859:0:13594:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1784403416.874936:0:13594:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1784403416.874942:0:13594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784403416.874947:0:13594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784403416.874953:0:13594:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784403416.874961:0:13594:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8c8a75f97000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784403416.874967:0:13594:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8c8a7fd2cd40) has exports, disconnecting them 00000020:00080000:2.0:1784403416.874972:0:13594:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8c8a75f97000), last request at 1784403184 00000020:00000080:2.0:1784403416.874977:0:13594:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa531 00000020:00080000:2.0:1784403416.874985:0:13594:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c8a75f97000): rc 0 00000020:00000080:2.0:1784403416.874991:0:13594:0:(genops.c:885:class_export_put()) final put ffff8c8a75f97000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1784403416.878244:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a7764d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784403416.878278:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a75f97000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1784403416.878378:0:13594:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784403416.878386:0:13594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784403416.878392:0:13594:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784403416.878399:0:13594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784403416.878439:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a75f94000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784403416.879465:0:13594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784403416.879482:0:13594:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1784403416.879490:0:13594:0:(genops.c:885:class_export_put()) final put ffff8c8a805fc000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1784403416.879495:0:13594:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a805fc000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1784403416.879510:0:13594:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1784403416.880105:0:13594:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a43036800 1 00000020:00000080:0.0:1784403416.880116:0:13594:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa4c1 00000020:00000080:0.0:1784403416.880125:0:13594:0:(genops.c:885:class_export_put()) final put ffff8c8a42c19800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1784403416.880216:0:13594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1784403416.880224:0:13594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784403416.880231:0:13594:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784403416.880236:0:13594:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8c8a580999c0) has no exports 00000020:00000080:1.0:1784403416.880277:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a42c19800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784403416.906490:0:13594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784403416.906514:0:13594:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1784403416.906522:0:13594:0:(genops.c:885:class_export_put()) final put ffff8c8a43030000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1784403416.906529:0:13594:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a43030000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1784403416.906554:0:13594:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1784403416.906807:0:13594:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c8a43032000 00000020:02000400:0.0:1784403416.907013:0:13594:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1784403416.931847:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403417.951666:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403418.975300:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784403419.991738:0:13747:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:1.0:1784403420.010755:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784403420.025064:0:13747:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1784403420.025184:0:13747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403420.025201:0:13747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403420.025209:0:13747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403420.025215:0:13747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403420.025242:0:13747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784403420.025249:0:13747:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784403420.025278:0:13747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784403420.025292:0:13747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c8a7744ad80 x1871082260879872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403422 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403420.025322:0:13747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c8a77448e00 x1871082260880384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403427 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403420.025344:0:13747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c8a7ae7dc00 x1871082260880512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403432 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403420.025354:0:13747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c8a73607800 x1871082260880768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403432 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403420.025394:0:13747:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1784403420.025435:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260880768:0@lo:400:kworker.0 00000100:00080000:3.0:1784403420.025468:0:13747:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784403420.025498:0:13747:0:(import.c:65:import_set_state_nolock()) ffff8c8a72e4d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784403420.026577:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784403420.026590:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403420.026602:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40030200 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:2.0:1784403420.026606:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403420.026617:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784403420.026625:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403420.026644:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784403420.026647:0:6280:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784403420.026650:0:6280:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784403420.026672:0:6280:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c8a5270e000 00010000:00010000:2.0:1784403420.026676:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403420.026683:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a40030200/0x6828175665afa6ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa6d5 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403420.026699:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403420.026701:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403420.026703:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403420.026731:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3564:1871082260880896:0@lo:39:umount.0 00000400:00000100:2.0:1784403420.026804:0:3564:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871082260880896 offset 0 length 224: 4 00000100:00100000:1.0:1784403420.027028:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260880384:0@lo:400:kworker.0 00000100:00100000:0.0:1784403420.027176:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260880512:0@lo:400:kworker.0 00000100:00100000:0.0:1784403420.027194:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3565:1871082260879872:0@lo:400:kworker.0 00010000:00010000:0.0:1784403421.024974:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784403421.919905:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 64472369-fee1-4bb4-a407-7797860a37a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784403421.919915:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 64472369-fee1-4bb4-a407-7797860a37a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1784403422.047917:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403423.071082:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403424.095303:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403425.119571:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403426.144170:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784403427.045652:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 64472369-fee1-4bb4-a407-7797860a37a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784403427.045663:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 64472369-fee1-4bb4-a407-7797860a37a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1784403427.168527:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403428.191130:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403429.217500:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403430.239176:0:8813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403430.304436:0:3564:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784403420/real 1784403420] req@ffff8c8a73607800 x1871082260880896/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784403430 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403430.304482:0:3564:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c8a73607800 x1871082260880896/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784403430 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784403430.304502:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a72e4d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784403430.304534:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3564:1871082260880896:0@lo:39:umount.0 00000100:00080000:3.0:1784403430.306110:0:13747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784403430.306119:0:13747:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784403430.306127:0:13747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784403430.307531:0:13747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403430.307552:0:13747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403430.307560:0:13747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403430.307567:0:13747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403430.307597:0:13747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403430.307605:0:13747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403430.307612:0:13747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403430.307618:0:13747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403430.307655:0:13747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403430.307676:0:13747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1784403430.307681:0:13747:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1784403430.309121:0:13747:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1784403430.309262:0:13747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1784403430.309273:0:13747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784403430.309284:0:13747:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784403430.309290:0:13747:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c8a72e44d40) has no exports 00000020:00080000:3.0:1784403430.309319:0:13747:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c8a72e44d40) has no exports 00010000:00010000:2.0:1784403430.309846:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784403430.309857:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403430.309931:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a40031e00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:2.0:1784403430.309936:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403430.309948:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784403430.309965:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403430.309971:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784403430.309974:0:6280:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1784403430.309978:0:6280:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1784403430.309995:0:6280:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c8a5270e000 00010000:00010000:2.0:1784403430.310000:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403430.310007:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a40031e00/0x6828175665afa6dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa6e3 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403430.310024:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784403430.310028:0:6280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403430.310034:0:6280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a41671000 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:2.0:1784403430.310037:0:6280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403430.310044:0:6280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784403430.310059:0:6280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403430.310065:0:6280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784403430.310068:0:6280:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784403430.310070:0:6280:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784403430.310076:0:6280:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c8a5270e000 00010000:00010000:2.0:1784403430.310080:0:6280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403430.310086:0:6280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a41671000/0x6828175665afa921 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa928 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403430.310113:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403430.310114:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403430.310116:0:6280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403430.310287:0:6279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1784403430.313933:0:13747:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c8a42c0d060 - data ffff8c8a77ac70d8/ffff8c8a7ff5f400 00000020:01000000:3.0:1784403430.314258:0:13747:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c8a7b5beba0 - data ffff8c8a77a0bbd0/ffff8c8a7b0b8800 00100000:10000000:3.0:1784403430.322613:0:13747:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784403430.366807:0:13747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa5d2 00000020:00000080:3.0:1784403430.366817:0:13747:0:(genops.c:885:class_export_put()) final put ffff8c8a72e4a000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1784403430.366843:0:13747:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c8a42cc6000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1784403430.366847:0:13747:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a42cc6000 2 00000020:01000004:3.0:1784403430.366850:0:13747:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c8a42cc6000 from lustre-OST0001 00000020:00000080:3.0:1784403430.366898:0:13747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784403430.366909:0:13747:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1784403430.367253:0:13747:0:(genops.c:885:class_export_put()) final put ffff8c8a805ff000/lustre-OST0001_UUID 00000020:00000080:3.0:1784403430.367258:0:13747:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a805ff000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1784403430.367267:0:13747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1784403430.367361:0:13747:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 64472369-fee1-4bb4-a407-7797860a37a0->MGS 00010000:00010000:3.0:1784403430.367379:0:13747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa4e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa4eb expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403430.367392:0:13747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa4e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa4eb expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403430.367412:0:13747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1784403430.367415:0:13747:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1784403430.367418:0:13747:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1784403430.367435:0:13747:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c8a5270e000 00010000:00010000:3.0:1784403430.367438:0:13747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a414fe000/0x6828175665afa4e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa4eb expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403430.367453:0:13747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a40030e00/0x6828175665afa722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6828175665afa729 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403430.367459:0:13747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a40030e00/0x6828175665afa722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6828175665afa729 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403430.367464:0:13747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784403430.367466:0:13747:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1784403430.367468:0:13747:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1784403430.367477:0:13747:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c8a5270e000 00010000:00010000:3.0:1784403430.367480:0:13747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a40030e00/0x6828175665afa722 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6828175665afa729 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784403430.367496:0:13747:0:(import.c:65:import_set_state_nolock()) ffff8c8a5270e000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1784403430.367500:0:13747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784403430.367502:0:13747:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784403430.367504:0:13747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784403430.367508:0:13747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784403430.367520:0:13747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c8a73604380 x1871082260880640/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784403431 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784403430.367539:0:13747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784403430.367543:0:13747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:3.0:1784403430.367574:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64472369-fee1-4bb4-a407-7797860a37a0:3564:1871082260880640:0@lo:250:kworker.0 10000000:01000000:3.0:1784403430.367605:0:13747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784403430.367612:0:13747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa3c5 00000020:00000080:3.0:1784403430.367617:0:13747:0:(genops.c:885:class_export_put()) final put ffff8c8a58002000/64472369-fee1-4bb4-a407-7797860a37a0 00000020:01000000:3.0:1784403430.367623:0:13747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.128@tcp (flags='') 00000020:00000080:3.0:1784403430.367628:0:13747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784403430.367632:0:13747:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.128@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784403430.367648:0:13747:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8c8a526f8000) has no exports 10000000:01000000:3.0:1784403430.367663:0:6290:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1784403430.367725:0:13747:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.128@tcp: client import never connected 00000100:00080000:3.0:1784403430.367728:0:13747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1784403430.367730:0:13747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784403430.367732:0:13747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1784403430.367733:0:13747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784403430.367775:0:13747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784403430.367780:0:13747:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.128@tcp (uuid 64472369-fee1-4bb4-a407-7797860a37a0) 00000020:01000000:3.0:1784403430.367786:0:13747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1784403430.367789:0:13747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784403430.367792:0:13747:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784403430.367796:0:13747:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8c8a72e4b000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784403430.367801:0:13747:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8c8a72e419c0) has exports, disconnecting them 00000020:00080000:3.0:1784403430.367805:0:13747:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8c8a72e4b000), last request at 1784403206 00000020:00000080:3.0:1784403430.367809:0:13747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa5fc 00000020:00080000:3.0:1784403430.367819:0:13747:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c8a72e4b000): rc 0 00000020:00000080:3.0:1784403430.367823:0:13747:0:(genops.c:885:class_export_put()) final put ffff8c8a72e4b000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1784403430.368127:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a72e4a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1784403430.368138:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a58002000/64472369-fee1-4bb4-a407-7797860a37a0 for MGC192.168.204.128@tcp 00000020:00000080:1.0:1784403430.368144:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a5270e000 for MGC192.168.204.128@tcp 00000020:00000080:1.0:1784403430.368150:0:37:0:(genops.c:885:class_export_put()) final put ffff8c8a522f2000/64472369-fee1-4bb4-a407-7797860a37a0 00000020:00000080:1.0:1784403430.368159:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a522f2000/64472369-fee1-4bb4-a407-7797860a37a0 for MGC192.168.204.128@tcp 00000020:01000000:1.0:1784403430.368163:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.128@tcp (64472369-fee1-4bb4-a407-7797860a37a0) 00000020:00000080:1.0:1784403430.368418:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a72e4b000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1784403430.370747:0:13747:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1784403430.370757:0:13747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784403430.370762:0:13747:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784403430.370770:0:13747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784403430.371470:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c8a72e4d800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1784403430.372046:0:8813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1784403430.372610:0:6280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1784403430.377678:0:6279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1784403430.378019:0:6274:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8c8a488bf200:6274] 0 exiting: rc = 1 00000100:00100000:1.0:1784403430.378403:0:8872:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8c8a775a1200:8872] 2 exiting: rc = 0 00000100:00100000:1.0:1784403430.378479:0:6275:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8c8a47304600:6275] 1 exiting: rc = 0 00000100:00100000:2.0:1784403430.378983:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.379402:0:6278:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8c8a47305600:6278] 2 exiting: rc = 0 00000100:00100000:1.0:1784403430.380119:0:6277:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8c8a47304400:6277] 1 exiting: rc = 0 00000100:00100000:0.0:1784403430.380908:0:6276:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8c8a47305200:6276] 0 exiting: rc = 1 00000100:00100000:1.0:1784403430.381255:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381264:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381271:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381277:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381283:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381288:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381294:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381300:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381309:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381316:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381321:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381327:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381333:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381340:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381347:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381353:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381360:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381365:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381369:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381376:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381381:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381398:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381403:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381408:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381412:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381417:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381421:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381426:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381431:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381436:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381441:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381459:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381465:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381469:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381474:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381480:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381486:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381492:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381496:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381502:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381507:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381516:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381533:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381538:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381544:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381550:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381555:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381560:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381566:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381571:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381577:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381582:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381594:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381600:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381605:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381610:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381623:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381628:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381633:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381651:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381656:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381661:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381666:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784403430.381672:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784403430.389044:0:13747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784403430.389058:0:13747:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1784403430.389065:0:13747:0:(genops.c:885:class_export_put()) final put ffff8c8a72e4b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1784403430.389070:0:13747:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a72e4b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1784403430.389077:0:13747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1784403430.389132:0:13747:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a42cc6000 1 00000020:00000080:1.0:1784403430.389139:0:13747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6828175665afa5a1 00000020:00000080:1.0:1784403430.389145:0:13747:0:(genops.c:885:class_export_put()) final put ffff8c8a736a5800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1784403430.389166:0:13747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1784403430.389171:0:13747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784403430.389175:0:13747:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784403430.389179:0:13747:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8c8a5809b380) has no exports 00000020:00000080:2.0:1784403430.389853:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a736a5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1784403430.420882:0:13747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784403430.420898:0:13747:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1784403430.420905:0:13747:0:(genops.c:885:class_export_put()) final put ffff8c8a42cc1800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1784403430.420909:0:13747:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a42cc1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1784403430.420931:0:13747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1784403430.421156:0:13747:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c8a42cc3000 00000020:01000000:2.0:1784403430.421189:0:13747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1784403430.421194:0:13747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784403430.421198:0:13747:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784403430.421202:0:13747:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8c8a527a3380) has no exports 00000020:00000080:2.0:1784403430.421293:0:13747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784403430.421304:0:13747:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1784403430.421307:0:13747:0:(genops.c:885:class_export_put()) final put ffff8c8a42c1a800/OSS_uuid 00000020:00000080:2.0:1784403430.421309:0:13747:0:(genops.c:844:class_export_destroy()) destroying export ffff8c8a42c1a800/OSS_uuid for OSS 00000020:01000000:2.0:1784403430.421315:0:13747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1784403430.421385:0:8571:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8c8a7ff45e00:8571] 3 exiting: rc = 0 00000100:00080000:3.0:1784403430.421712:0:6288:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1784403430.421733:0:7099:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8c8a453b2a00:7099] 0 exiting: rc = 1 00000100:00100000:0.0:1784403430.421807:0:7101:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8c8a453b2400:7101] 1 exiting: rc = 0 00000100:00100000:0.0:1784403430.427024:0:7102:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8c8a453b2800:7102] 2 exiting: rc = 0 00000100:00100000:2.0:1784403430.427218:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427229:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427239:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427247:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427254:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427264:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427271:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427279:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427286:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427290:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427295:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427300:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427305:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427309:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427314:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427319:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427324:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427329:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427334:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427339:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427345:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427349:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427354:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427359:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427364:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427382:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427387:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427393:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427399:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427403:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427408:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427413:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427417:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427495:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427505:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427510:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427515:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427521:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427526:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427531:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427536:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427541:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427546:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427551:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427556:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427562:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427566:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427572:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427576:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427580:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427585:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427589:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427594:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427599:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427605:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427611:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427616:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427621:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427627:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427632:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427645:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427650:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427655:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.427662:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403430.437518:0:7103:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8c8a453b3200:7103] 0 exiting: rc = 1 00000100:00100000:0.0:1784403430.437632:0:7104:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8c8a453b2600:7104] 1 exiting: rc = 0 00000100:00100000:2.0:1784403430.438011:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438021:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438027:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438032:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438037:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438043:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438049:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438054:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438059:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438064:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438069:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438074:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438080:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438085:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438090:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438095:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438100:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438105:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438111:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438116:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438122:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438127:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438133:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438138:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438143:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438148:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438153:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438159:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438165:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438170:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438175:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438193:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438198:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438204:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438209:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438314:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438325:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438330:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438335:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438339:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438344:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438350:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438354:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438360:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438366:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438370:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438375:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438380:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438384:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438389:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438394:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438400:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438405:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438411:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438416:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438421:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438426:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438431:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438435:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438441:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438446:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438451:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438456:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.438461:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440112:0:7107:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8c8a453b3a00:7107] 2 exiting: rc = 0 00000100:00100000:2.0:1784403430.440449:0:7105:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8c8a452ba000:7105] 0 exiting: rc = 1 00000100:00100000:2.0:1784403430.440616:0:7106:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8c8a453b3600:7106] 1 exiting: rc = 0 00000100:00100000:3.0:1784403430.440783:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440791:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440797:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440804:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440809:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440822:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440828:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440835:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440840:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440846:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440852:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440859:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440889:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440897:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440904:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440911:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440927:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440933:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440939:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440945:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440951:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440958:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440975:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440983:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440989:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.440995:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441001:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441007:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441013:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441020:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441026:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441032:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441037:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441043:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441049:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441055:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441061:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441067:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441073:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441077:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441091:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441097:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441102:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441107:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441113:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441119:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441143:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441150:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441155:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441160:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441166:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441171:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441176:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441181:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441187:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441193:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441198:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441204:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441211:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441305:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441313:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441318:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441324:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.441341:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784403430.447484:0:7108:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8c8a453b3e00:7108] 0 exiting: rc = 1 00000100:00100000:0.0:1784403430.447639:0:7109:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8c8a453b3800:7109] 1 exiting: rc = 0 00000100:00100000:3.0:1784403430.450844:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450859:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450888:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450896:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450901:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450906:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450910:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450926:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450930:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450935:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450941:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450959:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450972:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.450980:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451056:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451062:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451068:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451073:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451080:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451085:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451090:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451738:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451750:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451755:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451760:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451765:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451770:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451794:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451822:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451831:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451841:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451848:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451856:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451885:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451895:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451901:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451906:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451920:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451928:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451934:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451942:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451949:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451958:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451966:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451972:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.451981:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452001:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452013:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452022:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452027:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452033:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452039:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452044:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452050:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452056:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452060:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452065:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452069:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452074:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452079:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452084:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452089:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452094:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.452099:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784403430.455383:0:7111:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8c8a48a01400:7111] 1 exiting: rc = 0 00000100:00100000:1.0:1784403430.455692:0:7110:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8c8a81b81a00:7110] 0 exiting: rc = 1 00000100:00100000:3.0:1784403430.456653:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456670:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456677:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456683:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456689:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456695:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456702:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456708:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456715:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456722:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456738:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456744:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456750:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456756:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456762:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456767:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456772:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456788:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456793:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456799:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456804:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456810:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456828:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456834:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456840:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456845:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456851:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456856:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456862:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456883:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456889:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456896:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456902:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456908:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456939:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456947:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456954:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456961:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456968:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456975:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456981:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456988:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.456995:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457002:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457008:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457015:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457047:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457054:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457061:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457068:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457076:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457083:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457098:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457106:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457113:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457119:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457125:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457131:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457151:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457158:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457164:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457171:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457178:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784403430.457184:0:13747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1784403430.472454:0:13747:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1784403446.430847:0:14366:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784403453.589959:0:14779:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784403453.589966:0:14779:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1784403453.590081:0:14779:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c8a7303e800 00000020:01000004:2.0:1784403453.590100:0:14779:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784403453.590111:0:14779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784403453.590126:0:14779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c8a452b0000) 00000020:00000080:2.0:1784403453.590138:0:14779:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784403453.620412:0:14779:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1784403453.622996:0:14779:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1784403453.623416:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 547: rc = 0 00100000:10000000:3.0:1784403453.623771:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 547: rc = 0 00100000:10000000:3.0:1784403453.623908:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 547: rc = 0 00100000:10000000:3.0:1784403453.624008:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 547: rc = 0 00100000:10000000:3.0:1784403453.624151:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 547: rc = 0 00100000:10000000:3.0:1784403453.624344:0:14779:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1784403453.624418:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 547: rc = 0 00100000:10000000:3.0:1784403453.624832:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 549: rc = 0 00100000:10000000:3.0:1784403453.626248:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 569: rc = 0 00100000:10000000:3.0:1784403453.626353:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 569: rc = 0 00100000:10000000:3.0:1784403453.626907:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 577: rc = 0 00100000:10000000:3.0:1784403453.627259:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 577: rc = 0 00100000:10000000:3.0:1784403453.628221:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 577: rc = 0 00100000:10000000:3.0:1784403453.628539:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 577: rc = 0 00100000:10000000:3.0:1784403453.629206:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 577: rc = 0 00100000:10000000:3.0:1784403453.629490:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 577: rc = 0 00100000:10000000:3.0:1784403453.629910:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 577: rc = 0 00100000:10000000:3.0:1784403453.630216:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 577: rc = 0 00100000:10000000:3.0:1784403453.630471:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 577: rc = 0 00100000:10000000:3.0:1784403453.630747:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 577: rc = 0 00100000:10000000:3.0:1784403453.631249:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 577: rc = 0 00100000:10000000:3.0:1784403453.631539:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 577: rc = 0 00100000:10000000:3.0:1784403453.632581:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 684: rc = 0 00100000:10000000:2.0:1784403453.633476:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 684: rc = 0 00100000:10000000:2.0:1784403453.634002:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 684: rc = 0 00100000:10000000:2.0:1784403453.637301:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 684: rc = 0 00100000:10000000:2.0:1784403453.639056:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 684: rc = 0 00100000:10000000:2.0:1784403453.642131:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 684: rc = 0 00100000:10000000:2.0:1784403453.643710:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 684: rc = 0 00100000:10000000:2.0:1784403453.644541:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 684: rc = 0 00100000:10000000:2.0:1784403453.645951:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 684: rc = 0 00100000:10000000:2.0:1784403453.646680:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 684: rc = 0 00100000:10000000:2.0:1784403453.648523:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 684: rc = 0 00100000:10000000:2.0:1784403453.649533:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 684: rc = 0 00100000:10000000:2.0:1784403453.649907:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 684: rc = 0 00100000:10000000:2.0:1784403453.650847:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 684: rc = 0 00100000:10000000:2.0:1784403453.651811:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 684: rc = 0 00100000:10000000:2.0:1784403453.652572:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 684: rc = 0 00100000:10000000:3.0:1784403453.653502:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 684: rc = 0 00100000:10000000:3.0:1784403453.653850:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 684: rc = 0 00100000:10000000:3.0:1784403453.654476:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 684: rc = 0 00100000:10000000:3.0:1784403453.654827:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 684: rc = 0 00100000:10000000:3.0:1784403453.655690:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 684: rc = 0 00100000:10000000:3.0:1784403453.656452:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 684: rc = 0 00100000:10000000:3.0:1784403453.656849:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 684: rc = 0 00100000:10000000:3.0:1784403453.657166:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 684: rc = 0 00100000:10000000:3.0:1784403453.657495:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 684: rc = 0 00100000:10000000:3.0:1784403453.657757:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 684: rc = 0 00100000:10000000:3.0:1784403453.658107:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 684: rc = 0 00100000:10000000:3.0:1784403453.658357:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 684: rc = 0 00100000:10000000:3.0:1784403453.659471:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 684: rc = 0 00100000:10000000:3.0:1784403453.659757:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 684: rc = 0 00100000:10000000:3.0:1784403453.660427:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 684: rc = 0 00100000:10000000:3.0:1784403453.660695:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 684: rc = 0 00100000:10000000:3.0:1784403453.661441:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 673: rc = 0 00100000:10000000:3.0:1784403453.662180:0:14779:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1784403453.662619:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 570: rc = 0 00100000:10000000:3.0:1784403453.662821:0:14779:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1784403453.663452:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 570: rc = 0 00100000:10000000:3.0:1784403453.663682:0:14779:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1784403453.663753:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 570: rc = 0 00100000:10000000:3.0:1784403453.664501:0:14779:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1784403453.664582:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 574: rc = 0 00100000:10000000:3.0:1784403453.664783:0:14779:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1784403453.664853:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 574: rc = 0 00100000:10000000:3.0:1784403453.665377:0:14779:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1784403453.665454:0:14779:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 574: rc = 0 00000020:00000080:3.0:1784403453.665817:0:14779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784403453.665827:0:14779:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784403453.665838:0:14779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afb6c6 00000020:01000004:3.0:1784403453.665847:0:14779:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784403453.665852:0:14779:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784403453.665857:0:14779:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c8a7303e800 from MGS 00000020:01000004:3.0:1784403453.665861:0:14779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784403453.666100:0:14779:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c8a527a3380) 00000020:00000080:3.0:1784403453.666112:0:14779:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784403453.666176:0:14779:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a7303e800 from MGS, refs=2 00080000:01000000:3.0:1784403453.666182:0:14779:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784403453.666187:0:14779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afb6d4 00000100:00100000:3.0:1784403453.666580:0:14779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784403453.666709:0:14779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784403453.666716:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784403453.669686:0:14779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784403453.669701:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1784403453.671444:0:14779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784403453.671637:0:14779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1784403453.671643:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1784403453.672632:0:14779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1784403453.672641:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1784403453.673409:0:14779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1784403453.673418:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1784403453.674412:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403453.674417:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403453.674419:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403453.674692:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403453.674695:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403453.674697:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403453.675605:0:14779:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1784403453.679232:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1784403453.700072:0:14779:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1784403453.700092:0:14779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784403453.700095:0:14779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1784403453.703517:0:14788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784403453.704007:0:14779:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784403453.704135:0:14779:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784403453.704656:0:14779:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784403453.706089:0:14779:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784403453.706263:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784403453.706269:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784403453.709995:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784403453.710008:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784403453.710455:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784403453.710462:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784403453.711389:0:14779:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784403453.711411:0:14779:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.128@tcp' 00000020:01000004:1.0:1784403453.711413:0:14779:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1784403453.711443:0:14779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.128@tcp (typ=mgc) 00000020:00000080:1.0:1784403453.711456:0:14779:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.128@tcp (ffff8c8a72e419c0) 00000020:00000080:1.0:1784403453.711471:0:14779:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1784403453.711565:0:14779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c8a488ad800@MGC192.168.204.128@tcp: add connection 192.168.204.128@tcp at head 00010000:00010000:1.0:1784403453.711699:0:14779:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.128@tcp-0 is initialized 00000040:01000000:1.0:1784403453.711705:0:14779:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 1 is initialized 00000100:00080000:2.0:1784403453.713261:0:14793:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1784403453.719131:0:14794:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1784403453.719296:0:14779:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.128@tcp (uuid 001064a9-3cb5-489b-ba0a-bb457082004b) 00000020:00000080:0.0:1784403453.719332:0:14779:0:(genops.c:1385:class_connect()) connect: client 001064a9-3cb5-489b-ba0a-bb457082004b, cookie 0x6828175665afb6e2 00000100:00080000:0.0:1784403453.719360:0:14779:0:(import.c:510:import_select_connection()) MGC192.168.204.128@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784403453.719367:0:14779:0:(import.c:624:import_select_connection()) MGC192.168.204.128@tcp: import ffff8c8a488ad800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1784403453.719403:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8943276300 x1871082260881024/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784403453.719436:0:14779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 001064a9-3cb5-489b-ba0a-bb457082004b->MGS 00000020:01000004:0.0:1784403453.719457:0:14779:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1784403453.719462:0:14779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1784403453.719477:0:14779:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8c8a7fd2cd40) 00000020:00000080:0.0:1784403453.719509:0:14779:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784403453.721130:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:001064a9-3cb5-489b-ba0a-bb457082004b:3564:1871082260881024:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784403453.721211:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403453.721300:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260881024 00000100:00100000:2.0:1784403453.721309:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260881024 00000100:00100000:2.0:1784403453.721353:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403453.721362:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3564:x1871082260881024:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784403453.721390:0:14789:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 001064a9-3cb5-489b-ba0a-bb457082004b@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:2.0:1784403453.721420:0:14789:0:(genops.c:1385:class_connect()) connect: client 001064a9-3cb5-489b-ba0a-bb457082004b, cookie 0x6828175665afb6f0 00000100:00080000:2.0:1784403453.721593:0:14789:0:(import.c:65:import_set_state_nolock()) ffff8c8a510a8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784403453.721662:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+5:3564:x1871082260881024:12345-0@lo:250:mount.lustre.0 Request processed in 299us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403453.721673:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403453.721729:0:3564:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.128@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784403453.721740:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.128@tcp: connect to target with instance 0 00000100:00080000:2.0:1784403453.721749:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.128@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784403453.721755:0:3564:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784403453.721760:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a488ad800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784403453.721763:0:3564:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784403453.721775:0:3564:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784403453.721781:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:001064a9-3cb5-489b-ba0a-bb457082004b:3564:1871082260881024:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784403453.733953:0:14779:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784403453.735625:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1784403453.735634:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784403453.739219:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784403453.739232:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784403453.740203:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784403453.740212:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1784403453.741512:0:14779:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784403453.741690:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1784403453.741696:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1784403453.748567:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1784403453.748583:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784403453.817821:0:14779:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784403453.818206:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784403453.818213:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1784403453.822016:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1784403453.822032:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1784403453.834704:0:14779:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784403453.835156:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784403453.835163:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1784403453.836019:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784403453.836026:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1784403453.836713:0:14779:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784403453.837122:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784403453.837128:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784403453.838721:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784403453.839076:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784403453.839732:0:14779:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784403453.840097:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784403453.840108:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1784403453.840649:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784403453.840658:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1784403453.869525:0:14779:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784403453.869729:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784403453.869737:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1784403453.871742:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784403453.871755:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784403453.873489:0:14779:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784403453.873501:0:14779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784403453.874634:0:14779:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784403453.874660:0:14779:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1784403453.874668:0:14779:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784403453.874807:0:14779:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784403453.874844:0:14779:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.128@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1784403453.874849:0:14779:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784403453.874851:0:14779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784403453.874852:0:14779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403453.874853:0:14779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403453.874855:0:14779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403453.874856:0:14779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403453.874858:0:14779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784403453.874860:0:14779:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784403453.874862:0:14779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403453.875007:0:14779:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784403453.875011:0:14779:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1784403453.875014:0:14779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784403453.875015:0:14779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784403453.875016:0:14779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403453.875017:0:14779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403453.875018:0:14779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403453.875019:0:14779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403453.875020:0:14779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784403453.875021:0:14779:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784403453.875022:0:14779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403453.875023:0:14779:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784403453.875064:0:14779:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784403453.875086:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881152:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784403453.875229:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403453.875323:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403453.875400:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260881152 00000100:00100000:1.0:1784403453.875409:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260881152 00000100:00100000:1.0:1784403453.875496:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784403453.875506:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+5:14779:x1871082260881152:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784403453.875551:0:14792:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784403453.875554:0:14792:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784403453.875557:0:14792:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1784403453.875847:0:14812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1784403453.876243:0:14792:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1784403453.877463:0:14813:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1784403453.877470:0:14813:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1784403453.877473:0:14813:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1784403453.877518:0:14813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1784403453.877785:0:14792:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784403453.877795:0:14792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784403453.884804:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+5:14779:x1871082260881152:12345-0@lo:253:mount.lustre.0 Request processed in 9291us (9566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403453.884824:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784403453.885000:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881152:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784403453.885033:0:14779:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784403453.885037:0:14779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784403453.885039:0:14779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784403453.885041:0:14779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403453.885042:0:14779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403453.885043:0:14779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403453.885045:0:14779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403453.885046:0:14779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784403453.885048:0:14779:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784403453.885049:0:14779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403453.885051:0:14779:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784403453.885073:0:14779:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c8a7303e800 from lustre-MDT0000 10000000:01000000:2.0:1784403453.885103:0:14779:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784403453.885106:0:14779:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784403453.885246:0:14779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c8a72e419c0 10000000:01000000:2.0:1784403453.885252:0:14779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784403453.885320:0:14779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c8a72e419c0 from 1 10000000:01000000:2.0:1784403453.885325:0:14779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784403453.885362:0:14779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403453.885373:0:14779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403453.885382:0:14779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403453.885403:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784403453.885443:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403453.885495:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45ce0480 going to sleep for 11 seconds 00000100:00100000:1.0:1784403453.885607:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260881280 00000100:00100000:1.0:1784403453.885614:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260881280 00000100:00100000:1.0:1784403453.885690:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784403453.885699:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77613c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+5:14779:x1871082260881280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784403453.885714:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403453.885738:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a734a1c00/0x6828175665afb6fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb6f7 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403453.885764:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a734a1c00/0x6828175665afb6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb6f7 expref: 6 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403453.885776:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a734a1c00/0x6828175665afb6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb6f7 expref: 6 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403453.885786:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1c00, rc 0) 00000100:00100000:1.0:1784403453.885863:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77613c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+6:14779:x1871082260881280:12345-0@lo:101:mount.lustre.0 Request processed in 166us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403453.885890:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784403453.885970:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784403453.885986:0:14779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb6fe expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403453.886001:0:14779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb6fe expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403453.886060:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784403453.886090:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403453.886470:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403453.886559:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260881408 00000100:00100000:2.0:1784403453.886564:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260881408 00000100:00100000:2.0:1784403453.886590:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784403453.886604:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77610850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+6:14779:x1871082260881408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784403453.886860:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77610850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+6:14779:x1871082260881408:12345-0@lo:501:mount.lustre.0 Request processed in 256us (767us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784403453.886891:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784403453.886990:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881408:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784403453.887022:0:14779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784403453.887033:0:14779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb6fe expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403453.887043:0:14779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb6fe expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403453.887052:0:14779:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c8a7303e800 10000000:01000000:0.0:1784403453.887057:0:14779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784403453.887061:0:14779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c8a7303e800 10000000:01000000:0.0:1784403453.887064:0:14779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784403453.887067:0:14779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c8a7303e800 from 1 10000000:01000000:0.0:1784403453.887070:0:14779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784403453.887094:0:14779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afb705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403453.887102:0:14779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afb705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403453.887123:0:14779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afb705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403453.887144:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784403453.887187:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403453.887207:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403453.887442:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260881536 00000100:00100000:2.0:1784403453.887447:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260881536 00000100:00100000:2.0:1784403453.887470:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784403453.887489:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+6:14779:x1871082260881536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784403453.887499:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403453.887514:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afb70c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb705 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403453.887533:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afb70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb705 expref: 7 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403453.887543:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b3400/0x6828175665afb70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb705 expref: 7 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403453.887551:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3400, rc 0) 00000100:00100000:2.0:1784403453.887589:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+7:14779:x1871082260881536:12345-0@lo:101:mount.lustre.0 Request processed in 112us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403453.887595:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784403453.888042:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784403453.888057:0:14779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afb705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb70c expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403453.888065:0:14779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afb705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb70c expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403453.888078:0:14779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784403453.888083:0:14779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afb705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb70c expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403453.888090:0:14779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4600/0x6828175665afb705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb70c expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403453.888096:0:14779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784403453.888100:0:14779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784403453.888105:0:14779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c8a7303e800 10000000:01000000:0.0:1784403453.888449:0:14779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784403453.888454:0:14779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784403453.888457:0:14779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784403453.888491:0:14779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4e00/0x6828175665afb713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403453.888500:0:14779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4e00/0x6828175665afb713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403453.888518:0:14779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4e00/0x6828175665afb713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403453.888537:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784403453.888578:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403453.888614:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403453.888669:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260881664 00000100:00100000:2.0:1784403453.888675:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260881664 00000100:00100000:2.0:1784403453.888704:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784403453.888712:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+7:14779:x1871082260881664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784403453.888721:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403453.888743:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afb71a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb713 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403453.888767:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afb71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb713 expref: 8 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403453.888775:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b2200/0x6828175665afb71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb713 expref: 8 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403453.888784:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2200, rc 0) 00000100:00100000:2.0:1784403453.888821:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+8:14779:x1871082260881664:12345-0@lo:101:mount.lustre.0 Request processed in 110us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403453.888827:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784403453.889073:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784403453.889087:0:14779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4e00/0x6828175665afb713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb71a expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403453.889096:0:14779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4e00/0x6828175665afb713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb71a expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403453.892534:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784403453.892607:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403453.892644:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403453.892738:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260881792 00000100:00100000:2.0:1784403453.892746:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260881792 00000100:00100000:2.0:1784403453.892784:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784403453.892792:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+8:14779:x1871082260881792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784403453.893612:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+9:14779:x1871082260881792:12345-0@lo:501:mount.lustre.0 Request processed in 817us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403453.893622:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784403453.893790:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784403453.893834:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784403453.893894:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403453.893918:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403453.894417:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260881920 00000100:00100000:2.0:1784403453.894423:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260881920 00000100:00100000:2.0:1784403453.894451:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784403453.894459:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+9:14779:x1871082260881920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784403453.894847:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+9:14779:x1871082260881920:12345-0@lo:503:mount.lustre.0 Request processed in 386us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403453.894855:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784403453.895045:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260881920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784403453.896590:0:14814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14814:1871082260882048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403453.896666:0:14814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403453.896706:0:14814:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784403453.896822:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260882048 00000100:00100000:2.0:1784403453.896830:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260882048 00000100:00100000:2.0:1784403453.896910:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784403453.896919:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+9:14814:x1871082260882048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403453.897433:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+9:14814:x1871082260882048:12345-0@lo:502:llog_process_th.0 Request processed in 514us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403453.897442:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784403453.898384:0:14814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14814:1871082260882048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784403453.898425:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784403453.898436:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403453.898438:0:14814:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784403453.898443:0:14814:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784403453.898446:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784403453.898461:0:14814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c8a7fd299c0) 00000020:00000080:0.0:1784403453.898491:0:14814:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784403453.898497:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784403453.898569:0:14814:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784403453.898577:0:14814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afb728 00000020:00000080:0.0:1784403453.898788:0:14814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784403453.898793:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403453.898797:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403453.898799:0:14814:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784403453.898801:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784403453.898804:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403453.898805:0:14814:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784403453.898808:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784403453.898816:0:14814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c8a7fd28000) 00000020:00000080:0.0:1784403453.898825:0:14814:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784403453.898829:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784403453.898831:0:14814:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784403453.898834:0:14814:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784403453.898839:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784403453.898908:0:14814:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a7303e800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784403453.898923:0:14814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c8a7fd2b380) 00000020:00000080:0.0:1784403453.898931:0:14814:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784403453.898986:0:14814:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784403453.898991:0:14814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6828175665afb73d 00000020:00000080:0.0:1784403453.899081:0:14814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784403453.899088:0:14814:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784403453.899099:0:14814:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6828175665afb744 00080000:01000000:0.0:1784403453.899104:0:14814:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784403453.899107:0:14814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afb74b 00010000:00010000:2.0:1784403454.009789:0:14814:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1784403454.010428:0:14814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1784403454.010662:0:14814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784403454.011218:0:14814:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c8a452b4d40) 00000020:00000080:2.0:1784403454.011243:0:14814:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784403454.013583:0:14814:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784403454.013599:0:14814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afb759 00000020:00000080:0.0:1784403454.016463:0:14814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784403454.045517:0:14814:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6828175665afb760 00000020:00000080:2.0:1784403454.047214:0:14814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784403454.047230:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403454.047237:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403454.047239:0:14814:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784403454.047243:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784403454.047245:0:14814:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1784403454.047247:0:14814:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784403454.047249:0:14814:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784403454.047250:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784403454.047253:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403454.047255:0:14814:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784403454.047258:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784403454.047263:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403454.047265:0:14814:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784403454.047270:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784403454.047317:0:14814:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784403454.047342:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784403454.047345:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403454.047347:0:14814:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784403454.047358:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784403454.047361:0:14814:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1784403454.047365:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403454.047366:0:14814:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784403454.047369:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784403454.047375:0:14814:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.128@tcp to nid 0x20000c0a8cc80 (192.168.204.128@tcp) 00000020:01000000:2.0:1784403454.047404:0:14814:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784403454.047408:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784403454.047425:0:14814:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c8a452b19c0) 00000020:00000080:2.0:1784403454.047441:0:14814:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1784403454.047446:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784403454.047518:0:14814:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784403454.047525:0:14814:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784403454.047531:0:14814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afb76e 00010000:00080000:2.0:1784403454.047580:0:14814:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c8a7b37b800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:2.0:1784403454.047839:0:14814:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1784403454.049507:0:14814:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784403454.049564:0:14814:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784403454.052104:0:14814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784403454.052210:0:14814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1784403454.053256:0:14814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1784403454.054439:0:14818:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784403454.054447:0:14818:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784403454.056390:0:14814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784403454.056507:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784403454.056556:0:14814:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784403454.056580:0:14814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6828175665afb775 00000100:00080000:1.0:1784403454.056592:0:14814:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784403454.056599:0:14814:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c8a7b37b800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1784403454.056638:0:14814:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a7ae7d880 x1871082260882176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784403454.056669:0:14814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1784403454.056822:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260882176:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1784403454.056941:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403454.056946:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403454.056948:0:14814:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784403454.056952:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784403454.056955:0:14814:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1784403454.056956:0:14814:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784403454.056958:0:14814:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784403454.056959:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784403454.056962:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403454.056964:0:14814:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784403454.056980:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784403454.056985:0:14814:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784403454.056989:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403454.056990:0:14814:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000400:00000100:2.0:1784403454.057004:0:3564:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871082260882176 offset 0 length 520: 4 00000020:00000080:1.0:1784403454.057123:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784403454.057128:0:14814:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.128@tcp to nid 0x20000c0a8cc80 (192.168.204.128@tcp) 00000020:01000000:1.0:1784403454.057151:0:14814:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784403454.057154:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784403454.057380:0:14814:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c8a72e40000) 00000020:00000080:1.0:1784403454.057398:0:14814:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1784403454.057405:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784403454.057470:0:14814:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1784403454.057487:0:14814:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784403454.057493:0:14814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6828175665afb783 00010000:00080000:1.0:1784403454.057522:0:14814:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c8a52cc7800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:1.0:1784403454.057762:0:14814:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1784403454.067209:0:14814:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784403454.067440:0:14814:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784403454.068834:0:14814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784403454.068952:0:14814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1784403454.069044:0:14814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1784403454.070455:0:14820:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784403454.070462:0:14820:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1784403454.073819:0:14814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784403454.074176:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784403454.074227:0:14814:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784403454.074252:0:14814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6828175665afb78a 00000100:00080000:1.0:1784403454.074265:0:14814:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784403454.074271:0:14814:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c8a52cc7800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1784403454.074312:0:14814:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a7ae7f480 x1871082260882304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784403454.074417:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260882304:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784403454.074562:0:3564:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871082260882304 offset 0 length 520: 4 00000100:00080000:1.0:1784403454.074697:0:14814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1784403454.074796:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403454.074801:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403454.074803:0:14814:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784403454.074806:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403454.074811:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403454.074813:0:14814:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784403454.074816:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784403454.074818:0:14814:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784403454.074821:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403454.074823:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403454.074825:0:14814:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784403454.074827:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403454.074829:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403454.074831:0:14814:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784403454.074840:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784403454.074916:0:14814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14814:1871082260882432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403454.075043:0:14814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403454.075092:0:14814:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a499d1840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403454.075110:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260882432 00000100:00100000:3.0:1784403454.075119:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260882432 00000100:00100000:3.0:1784403454.075174:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784403454.075184:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+9:14814:x1871082260882432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403454.075493:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+9:14814:x1871082260882432:12345-0@lo:502:llog_process_th.0 Request processed in 310us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403454.075502:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784403454.075587:0:14814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14814:1871082260882432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784403454.075618:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403454.075624:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403454.075626:0:14814:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784403454.075630:0:14814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1784403454.075717:0:14779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1784403454.075742:0:14779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784403454.075769:0:14779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4e00/0x6828175665afb713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb71a expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403454.075781:0:14779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4e00/0x6828175665afb713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb71a expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403454.075790:0:14779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c8a7303e800 from 1 10000000:01000000:3.0:1784403454.075793:0:14779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784403454.075822:0:14779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403454.075837:0:14779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403454.075847:0:14779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403454.075893:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260882560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784403454.075943:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403454.075964:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a453509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403454.076029:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260882560 00000100:00100000:0.0:1784403454.076033:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260882560 00000100:00100000:0.0:1784403454.076071:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784403454.076090:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+9:14779:x1871082260882560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784403454.076101:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403454.076117:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce4800/0x6828175665afb798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb791 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403454.076142:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce4800/0x6828175665afb798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb791 expref: 10 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403454.076154:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce4800/0x6828175665afb798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb791 expref: 10 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403454.076163:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4800, rc 0) 00000100:00100000:0.0:1784403454.076211:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+10:14779:x1871082260882560:12345-0@lo:101:mount.lustre.0 Request processed in 133us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403454.076217:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784403454.076372:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260882560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784403454.076388:0:14779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.076399:0:14779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403454.076998:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260882688:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1784403454.078145:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403454.078182:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7349d840 going to sleep for 11 seconds 00000100:00100000:1.0:1784403454.078336:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260882688 00000100:00100000:1.0:1784403454.078344:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260882688 00000100:00100000:1.0:1784403454.078482:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784403454.078492:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+10:14779:x1871082260882688:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784403454.078520:0:14791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784403454.078526:0:14791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1784403454.078608:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+10:14779:x1871082260882688:12345-0@lo:256:mount.lustre.0 Request processed in 118us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403454.078617:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784403454.078639:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260882688:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1784403454.080184:0:14779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784403454.080216:0:14779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403454.080229:0:14779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403454.080239:0:14779:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a7303e800 from 1 10000000:01000000:3.0:1784403454.080242:0:14779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784403454.080282:0:14779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403454.080291:0:14779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403454.080301:0:14779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403454.080340:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260882816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784403454.080484:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403454.081689:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45350d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784403454.081744:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260882816 00000100:00100000:2.0:1784403454.082105:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260882816 00000100:00100000:2.0:1784403454.082157:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784403454.082168:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+10:14779:x1871082260882816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784403454.082185:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403454.082205:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afb7a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb79f expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403454.082243:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afb7a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb79f expref: 11 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403454.082254:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afb7a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb79f expref: 11 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403454.082263:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3e00, rc 0) 00000100:00100000:2.0:1784403454.082363:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+11:14779:x1871082260882816:12345-0@lo:101:mount.lustre.0 Request processed in 196us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403454.082370:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784403454.082522:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260882816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784403454.082540:0:14779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403454.082550:0:14779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403454.082617:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260882944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784403454.082649:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403454.082714:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45350d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784403454.082746:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260882944 00000100:00100000:2.0:1784403454.083226:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260882944 00000100:00100000:2.0:1784403454.083258:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784403454.083265:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+11:14779:x1871082260882944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784403454.083797:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+11:14779:x1871082260882944:12345-0@lo:501:mount.lustre.0 Request processed in 531us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403454.083806:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784403454.085325:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260882944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784403454.085457:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260883072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784403454.085543:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403454.085591:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45350d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784403454.085627:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260883072 00000100:00100000:1.0:1784403454.085635:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260883072 00000100:00100000:1.0:1784403454.085693:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784403454.085704:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+11:14779:x1871082260883072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784403454.086056:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+11:14779:x1871082260883072:12345-0@lo:503:mount.lustre.0 Request processed in 353us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403454.086065:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784403454.086237:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260883072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784403454.087506:0:14822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14822:1871082260883200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403454.087582:0:14822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403454.087664:0:14822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45350540 going to sleep for 11 seconds 00000100:00100000:1.0:1784403454.087704:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260883200 00000100:00100000:1.0:1784403454.087712:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260883200 00000100:00100000:1.0:1784403454.088374:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784403454.088489:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+11:14822:x1871082260883200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403454.089151:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+11:14822:x1871082260883200:12345-0@lo:502:llog_process_th.0 Request processed in 664us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403454.089160:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784403454.089254:0:14822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14822:1871082260883200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784403454.089287:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784403454.089300:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403454.089302:0:14822:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784403454.089307:0:14822:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a7303e800 00000020:00000080:3.0:1784403454.089309:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784403454.089315:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784403454.089317:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403454.089317:0:14822:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784403454.089319:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784403454.089321:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403454.089321:0:14822:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784403454.089323:0:14822:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a7303e800 00000020:00000080:3.0:1784403454.089324:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784403454.089457:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784403454.089461:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403454.089462:0:14822:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784403454.089464:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784403454.089467:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403454.089468:0:14822:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784403454.089482:0:14822:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c8a7303e800 00000020:00000080:3.0:1784403454.089484:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784403454.091055:0:14822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14822:1871082260883328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784403454.091144:0:14822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403454.091250:0:14822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45350540 going to sleep for 11 seconds 00000100:00100000:2.0:1784403454.091298:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260883328 00000100:00100000:2.0:1784403454.091306:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260883328 00000100:00100000:2.0:1784403454.091451:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784403454.091461:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+11:14822:x1871082260883328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784403454.091693:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+11:14822:x1871082260883328:12345-0@lo:502:llog_process_th.0 Request processed in 232us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403454.091702:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784403454.091798:0:14822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14822:1871082260883328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784403454.092129:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784403454.092137:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403454.092140:0:14822:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784403454.092143:0:14822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1784403454.093011:0:14779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1784403454.093033:0:14779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784403454.093047:0:14779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.093060:0:14779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403454.093118:0:14779:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784403454.093121:0:14779:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c8a7303e800 10000000:01000000:1.0:1784403454.093125:0:14779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c8a7303e800 10000000:01000000:1.0:1784403454.093129:0:14779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784403454.093135:0:14779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a7303e800 from 1 10000000:01000000:1.0:1784403454.093138:0:14779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784403454.093174:0:14779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1000/0x6828175665afb7ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.093185:0:14779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1000/0x6828175665afb7ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.093196:0:14779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1000/0x6828175665afb7ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403454.093220:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260883456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784403454.093274:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403454.093310:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fde40 going to sleep for 11 seconds 00000100:00100000:1.0:1784403454.093331:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260883456 00000100:00100000:1.0:1784403454.093336:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260883456 00000100:00100000:1.0:1784403454.093389:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784403454.093399:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+11:14779:x1871082260883456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784403454.093411:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403454.093425:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a734a0200/0x6828175665afb7b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb7ad expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.093449:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a734a0200/0x6828175665afb7b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb7ad expref: 12 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.093482:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a734a0200/0x6828175665afb7b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb7ad expref: 12 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.093492:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0200, rc 0) 00000100:00100000:1.0:1784403454.093528:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+12:14779:x1871082260883456:12345-0@lo:101:mount.lustre.0 Request processed in 131us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403454.093535:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784403454.093583:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260883456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784403454.093597:0:14779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1000/0x6828175665afb7ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7b4 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.093606:0:14779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1000/0x6828175665afb7ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb7b4 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403454.093654:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260883584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784403454.093678:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403454.093691:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fde40 going to sleep for 11 seconds 00000100:00100000:2.0:1784403454.094093:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260883584 00000100:00100000:2.0:1784403454.094099:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260883584 00000100:00100000:2.0:1784403454.094143:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784403454.094150:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:14779:x1871082260883584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784403454.094404:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:14779:x1871082260883584:12345-0@lo:501:mount.lustre.0 Request processed in 254us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403454.094412:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784403454.096122:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260883584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784403454.096183:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260883712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784403454.096249:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403454.096282:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fde40 going to sleep for 11 seconds 00000100:00100000:1.0:1784403454.096303:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260883712 00000100:00100000:1.0:1784403454.096309:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260883712 00000100:00100000:1.0:1784403454.096347:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784403454.096355:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+12:14779:x1871082260883712:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784403454.096575:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+12:14779:x1871082260883712:12345-0@lo:503:mount.lustre.0 Request processed in 220us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403454.096583:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784403454.096635:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260883712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784403454.097533:0:14824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14824:1871082260883840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403454.097587:0:14824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403454.097622:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260883840 00000100:00100000:1.0:1784403454.097628:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260883840 00000100:00100000:1.0:1784403454.097662:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784403454.097670:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+12:14824:x1871082260883840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784403454.099663:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+12:14824:x1871082260883840:12345-0@lo:502:llog_process_th.0 Request processed in 1984us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403454.099677:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784403454.099749:0:14824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403454.100102:0:14824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14824:1871082260883840:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1784403454.100178:0:14824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784403454.100194:0:14824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c8a72e43380) 00000020:00000080:1.0:1784403454.100215:0:14824:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1784403454.100373:0:14824:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a7303e800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784403454.101530:0:14824:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c8a7303e800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784403454.101536:0:14824:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a7303e800 4 00010000:00080000:1.0:1784403454.101593:0:14824:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c8a4891f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:1.0:1784403454.110964:0:14824:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1784403454.111152:0:14824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784403454.111209:0:14824:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784403454.111230:0:14824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6828175665afb7c2 00000100:00080000:1.0:1784403454.111241:0:14824:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784403454.111248:0:14824:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c8a4891f000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1784403454.111287:0:14824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a7ae7e680 x1871082260883968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784403454.111327:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3564:1871082260883968:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784403454.111402:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784403454.111463:0:14824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784403454.111490:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260883968 00000100:00100000:3.0:1784403454.111498:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260883968 00000100:00100000:3.0:1784403454.111531:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784403454.111539:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3564:x1871082260883968:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784403454.111795:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3564:x1871082260883968:12345-0@lo:38:llog_process_th.0 Request processed in 254us (391us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784403454.111803:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784403454.111862:0:3564:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784403454.111948:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a4891f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784403454.111953:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784403454.111957:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3564:1871082260883968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784403454.113216:0:14824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14824:1871082260884096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403454.113289:0:14824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403454.113331:0:14824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cf73b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784403454.114710:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260884096 00000100:00100000:0.0:1784403454.114722:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260884096 00000100:00100000:0.0:1784403454.114787:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784403454.114798:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:14824:x1871082260884096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784403454.117771:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:14824:x1871082260884096:12345-0@lo:502:llog_process_th.0 Request processed in 2965us (4471us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403454.117788:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784403454.117895:0:14824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:001064a9-3cb5-489b-ba0a-bb457082004b:14824:1871082260884096:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784403454.117937:0:14824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784403454.118894:0:14779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1784403454.118922:0:14779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784403454.118945:0:14779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1000/0x6828175665afb7ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7b4 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.118958:0:14779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1000/0x6828175665afb7ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7b4 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784403454.119247:0:14779:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784403454.119249:0:14779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784403454.119251:0:14779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403454.119253:0:14779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784403454.119254:0:14779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403454.119256:0:14779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403454.119257:0:14779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784403454.119259:0:14779:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784403454.119261:0:14779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403454.119262:0:14779:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784403454.119266:0:14779:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1784403454.119268:0:14779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784403454.119270:0:14779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784403454.119271:0:14779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403454.119272:0:14779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784403454.119273:0:14779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403454.119274:0:14779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403454.119280:0:14779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784403454.119281:0:14779:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784403454.119283:0:14779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403454.119284:0:14779:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784403454.119310:0:14779:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784403454.119331:0:14779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260884224:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784403454.119391:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403454.119462:0:14779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a42bbc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403454.120090:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260884224 00000100:00100000:0.0:1784403454.120154:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260884224 00000100:00100000:0.0:1784403454.120211:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784403454.120232:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+12:14779:x1871082260884224:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784403454.120264:0:14791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784403454.120680:0:14791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784403454.181454:0:14791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784403454.181481:0:14791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784403454.182333:0:14812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784403454.182340:0:14812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784403454.182365:0:14812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403454.182386:0:14812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce4800/0x6828175665afb798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb791 expref: 12 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403454.182408:0:14812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403454.182452:0:14812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce4800/0x6828175665afb798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afb791 expref: 12 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403454.182466:0:14812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7fce4800/0x6828175665afb798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afb791 expref: 12 pid: 14792 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403454.182493:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14812:1871082260884352:0@lo:104: 00000100:00100000:0.0:1784403454.182577:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403454.182764:0:14780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260884352 00000100:00100000:2.0:1784403454.182772:0:14780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260884352 00000100:00100000:0.0:1784403454.182811:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7cf73d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784403454.183437:0:14780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403454.183449:0:14780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943274a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+3:14812:x1871082260884352:12345-0@lo:104: 00010000:00010000:2.0:1784403454.183464:0:14780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403454.183550:0:14780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784403454.183556:0:14780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943274a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+3:14812:x1871082260884352:12345-0@lo:104: Request processed in 111us (980us total) trans 0 rc 0/0 00010000:00010000:1.0:1784403454.183647:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403454.183656:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.183664:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7a00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403454.183669:0:14786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.183678:0:14786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403454.183686:0:14786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403454.183693:0:14786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784403454.183858:0:14786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.183882:0:14786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403454.183904:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.183912:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb798 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.183942:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403454.183944:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403454.183946:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403454.183985:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260884480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403454.184023:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403454.184093:0:14782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260884480 00000100:00100000:1.0:1784403454.184099:0:14782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260884480 00010000:00010000:1.0:1784403454.184123:0:14782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce4800/0x6828175665afb798 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb791 expref: 13 pid: 14792 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403454.184146:0:14782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784403454.184153:0:14782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:001064a9-3cb5-489b-ba0a-bb457082004b+13:3567:x1871082260884480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403454.184165:0:14782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403454.184171:0:14782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce4800/0x6828175665afb798 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb791 expref: 13 pid: 14792 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.184182:0:14782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce4800/0x6828175665afb798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afb791 expref: 13 pid: 14792 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.184200:0:14782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.184209:0:14782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784403454.184224:0:14782:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001885041s 00010000:00010000:1.0:1784403454.184229:0:14782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.184248:0:14782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.184255:0:14782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.184262:0:14782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.184268:0:14782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403454.184272:0:14782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.184280:0:14782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.184289:0:14782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403454.184299:0:14782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403454.184330:0:14782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:001064a9-3cb5-489b-ba0a-bb457082004b+13:3567:x1871082260884480:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403454.184338:0:14782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784403454.184378:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260884480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784403454.184444:0:14780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784403454.184537:0:14812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce4800/0x6828175665afb798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afb791 expref: 12 pid: 14792 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403454.184551:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943276a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14812:1871082260884352:0@lo:104: 00010000:00010000:3.0:1784403454.184647:0:14812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403454.184657:0:14812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403454.184664:0:14812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403454.184671:0:14812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb7c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403454.194839:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+11:14779:x1871082260884224:12345-0@lo:253:mount.lustre.0 Request processed in 74600us (75438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403454.194856:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784403454.194986:0:14779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:14779:1871082260884224:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784403454.195004:0:14779:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784403454.195009:0:14779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784403454.195011:0:14779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784403454.195025:0:14779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403454.195027:0:14779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784403454.195028:0:14779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403454.195029:0:14779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403454.195031:0:14779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784403454.195033:0:14779:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784403454.195035:0:14779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403454.195036:0:14779:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784403454.195051:0:14779:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784403454.200705:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403454.201034:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784403454.201398:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403454.201577:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784403454.202023:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403454.202193:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1784403454.203222:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403454.203467:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1784403454.203839:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403454.204145:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1784403454.204502:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1784403454.204668:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1784403454.235716:0:14779:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1784403454.236409:0:14779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1784403454.236683:0:14835:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1784403454.237884:0:14835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1784403454.241395:0:14834:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1784403454.241403:0:14834:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1784403454.243207:0:14779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784403454.243432:0:14835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784403454.243519:0:14835:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784403454.243523:0:14835:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1784403454.246123:0:14779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784403454.247099:0:14779:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784403454.247118:0:14779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784403454.247504:0:14779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784403454.248713:0:14779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784403454.249609:0:14779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784403454.249650:0:14779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1784403454.252027:0:14779:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1784403454.258483:0:14779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1784403454.298548:0:14779:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784403454.298589:0:14779:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3f141d77988 00100000:10000000:1.0:1784403454.298599:0:14779:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1784403454.299633:0:14779:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784403454.299649:0:14779:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784403454.299663:0:14779:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1784403454.299679:0:14779:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1784403454.688599:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784403455.006994:0:14794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784403455.007003:0:14794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c8a7303e800 from 6 10000000:01000000:1.0:1784403455.007009:0:14794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784403455.007060:0:14794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403455.007074:0:14794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403455.007086:0:14794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403455.007122:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260884608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784403455.007218:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403455.007312:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a51b15900 going to sleep for 11 seconds 00000100:00100000:0.0:1784403455.007451:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260884608 00000100:00100000:0.0:1784403455.007474:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260884608 00000100:00100000:0.0:1784403455.007532:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784403455.007542:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+11:14794:x1871082260884608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403455.007556:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403455.007571:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afb7d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb7d0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403455.007594:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afb7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb7d0 expref: 12 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403455.007604:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afb7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb7d0 expref: 12 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403455.007625:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5a00, rc 0) 00000100:00100000:0.0:1784403455.007713:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:14794:x1871082260884608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403455.007721:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784403455.007920:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260884608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403455.007937:0:14794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403455.007947:0:14794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403455.008002:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260884736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784403455.008036:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403455.008055:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43012900 going to sleep for 11 seconds 00000100:00100000:0.0:1784403455.008109:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260884736 00000100:00100000:0.0:1784403455.008113:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260884736 00000100:00100000:0.0:1784403455.008142:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784403455.008150:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+12:14794:x1871082260884736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784403455.008165:0:14791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784403455.008181:0:14791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784403455.008185:0:14791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1784403455.009770:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+12:14794:x1871082260884736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1612us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403455.009782:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784403455.010123:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260884736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784403455.010188:0:14794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784403455.010197:0:14794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403455.010209:0:14794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784403455.135699:0:14830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784403455.712049:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784403456.163685:0:14830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784403456.735030:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403457.759202:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784403458.232562:0:15077:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784403458.785083:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784403459.299481:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784403459.299491:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784403459.299495:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784403459.299498:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784403459.299501:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784403459.299505:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784403459.299509:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c8a4891f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784403459.299530:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c8a4891f000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1784403459.299584:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8943275500 x1871082260884992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784403459.299711:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784403459.299729:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943276d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260884864:0@lo:400:kworker.0 00000100:00100000:0.0:1784403459.299804:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403459.299897:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260884864 00000100:00100000:0.0:1784403459.299905:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260884864 00000100:00100000:0.0:1784403459.299957:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784403459.299966:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+12:3567:x1871082260884864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403459.300137:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+12:3567:x1871082260884864:12345-0@lo:400:kworker.0 Request processed in 171us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403459.300145:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784403459.300179:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3564:1871082260884992:0@lo:38:kworker.0 00000100:00100000:0.0:1784403459.300205:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403459.300260:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943276d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260884864:0@lo:400:kworker.0 00000100:00100000:0.0:1784403459.307998:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260884992 00000100:00100000:0.0:1784403459.308015:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260884992 00000100:00100000:0.0:1784403459.308107:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403459.308115:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3564:x1871082260884992:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784403459.308148:0:14798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:0.0:1784403459.308189:0:14798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6828175665afb7de 00000004:00100000:0.0:1784403459.308206:0:14798:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784403459.308329:0:14798:0:(import.c:65:import_set_state_nolock()) ffff8c8a7ffde800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784403459.308424:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3564:x1871082260884992:12345-0@lo:38:kworker.0 Request processed in 307us (8217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403459.308438:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784403459.308490:0:3564:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c8943275500 x1871082260884992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784403469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784403459.308509:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784403459.308517:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784403459.308521:0:3564:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784403459.308524:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a4891f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784403459.308530:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3564:1871082260884992:0@lo:38:kworker.0 00010000:00010000:0.0:1784403459.809690:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784403460.761403:0:15228:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffab70c3c0 20000000:00000080:1.0:1784403460.761421:0:15228:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c8a7d14c000 uarg=0000000000000000 20000000:01000000:1.0:1784403460.761460:0:15228:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784403460.761468:0:15228:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784403460.761473:0:15228:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1784403460.762264:0:15229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1784403460.762435:0:15228:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784403460.769540:0:15228:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784403460.769570:0:15228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403460.769590:0:15228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afb7a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb79f expref: 11 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403460.769660:0:15228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403460.769710:0:15228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afb7a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afb79f expref: 11 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403460.769725:0:15228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afb7a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afb79f expref: 11 pid: 14789 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403460.769751:0:15228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15228:1871082260885120:0@lo:104: 00000100:00100000:1.0:1784403460.769820:0:15228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403460.769894:0:15228:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586cdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784403460.769963:0:14780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260885120 00000100:00100000:3.0:1784403460.769972:0:14780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260885120 00000100:00100000:3.0:1784403460.770038:0:14780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784403460.770049:0:14780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+3:15228:x1871082260885120:12345-0@lo:104: 00010000:00010000:3.0:1784403460.770068:0:14780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403460.770122:0:14780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784403460.770292:0:15228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15228:1871082260885120:0@lo:104: 00010000:00010000:1.0:1784403460.770315:0:15228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403460.770359:0:14780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+3:15228:x1871082260885120:12345-0@lo:104: Request processed in 82us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403460.770368:0:14780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1784403460.770388:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403460.770394:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403460.770402:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7600 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:3.0:1784403460.770406:0:14785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403460.770414:0:14785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784403460.770421:0:14785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403460.770428:0:14785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784403460.770473:0:14785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403460.770481:0:14785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784403460.770503:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403460.770511:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb79f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb7a6 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403460.770537:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403460.770537:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:001064a9-3cb5-489b-ba0a-bb457082004b:3565:1871082260885248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403460.770541:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403460.770545:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403460.770582:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403460.770631:0:14782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260885248 00000100:00100000:0.0:1784403460.770636:0:14782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260885248 00010000:00010000:0.0:1784403460.770661:0:14782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afb7a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb79f expref: 12 pid: 14789 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403460.770686:0:14782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403460.770694:0:14782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943275500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:001064a9-3cb5-489b-ba0a-bb457082004b+12:3565:x1871082260885248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784403460.770706:0:14782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403460.770713:0:14782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afb7a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb79f expref: 12 pid: 14789 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.770725:0:14782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afb7a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afb79f expref: 12 pid: 14789 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.770737:0:14782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afb7a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afb79f expref: 12 pid: 14789 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.770761:0:14782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.770770:0:14782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.770783:0:14782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.770791:0:14782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.770798:0:14782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.770806:0:14782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.770812:0:14782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403460.770817:0:14782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.770826:0:14782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.771047:0:14782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403460.771054:0:15228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403460.771060:0:14782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784403460.771078:0:15228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403460.771088:0:15228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a734a0400/0x6828175665afb7e5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403460.771106:0:14782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943275500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:001064a9-3cb5-489b-ba0a-bb457082004b+11:3565:x1871082260885248:12345-0@lo:103:ldlm_bl.0 Request processed in 412us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403460.771122:0:14782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784403460.772986:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:001064a9-3cb5-489b-ba0a-bb457082004b:3565:1871082260885248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403460.832211:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403461.855988:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784403462.430940:0:14794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784403462.430950:0:14794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a7303e800 from 10 10000000:01000000:1.0:1784403462.430956:0:14794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784403462.431003:0:14794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403462.431032:0:14794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403462.431045:0:14794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403462.431073:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260885376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784403462.431152:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403462.431206:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a412ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1784403462.431456:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260885376 00000100:00100000:2.0:1784403462.431471:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260885376 00000100:00100000:2.0:1784403462.431530:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784403462.431541:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+11:14794:x1871082260885376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784403462.431554:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403462.431569:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b3000/0x6828175665afb7f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb7ec expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403462.431591:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b3000/0x6828175665afb7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb7ec expref: 12 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403462.431602:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b3000/0x6828175665afb7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb7ec expref: 12 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403462.431610:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3000, rc 0) 00000100:00100000:2.0:1784403462.431664:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+12:14794:x1871082260885376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403462.431672:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784403462.432205:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260885376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403462.432223:0:14794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403462.432234:0:14794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403462.432299:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260885504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403462.432346:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403462.432373:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a412ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1784403462.432450:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260885504 00000100:00100000:2.0:1784403462.432455:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260885504 00000100:00100000:2.0:1784403462.432490:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784403462.432498:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a433fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:14794:x1871082260885504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784403462.432757:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a433fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:14794:x1871082260885504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403462.432765:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784403462.432946:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260885504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403462.432981:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260885632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403462.433022:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403462.433050:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a45718600 going to sleep for 11 seconds 00000100:00100000:1.0:1784403462.436455:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260885632 00000100:00100000:1.0:1784403462.436470:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260885632 00000100:00100000:1.0:1784403462.436532:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784403462.436543:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a433f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+12:14794:x1871082260885632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784403462.436800:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a433f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+12:14794:x1871082260885632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403462.436807:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784403462.436893:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260885632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784403462.437730:0:15304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1784403462.438102:0:14794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1784403462.438123:0:14794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784403462.438134:0:14794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403462.438145:0:14794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403462.885684:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403463.902996:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784403464.364148:0:15428:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784403464.364153:0:15428:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1784403464.364369:0:15428:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c8a5270a000 00000020:01000004:2.0:1784403464.364386:0:15428:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1784403464.364409:0:15428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784403464.364423:0:15428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c8a452b3380) 00000020:00000080:2.0:1784403464.364440:0:15428:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784403464.385774:0:15428:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784403464.386150:0:15428:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1784403464.387290:0:15428:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784403464.387567:0:15428:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1784403464.387964:0:15428:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1784403464.389351:0:15428:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 551: rc = 0 00100000:10000000:3.0:1784403464.389456:0:15428:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 551: rc = 0 00100000:10000000:3.0:1784403464.389595:0:15428:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 551: rc = 0 00100000:10000000:3.0:1784403464.390423:0:15428:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 450: rc = 0 00100000:10000000:3.0:1784403464.390767:0:15428:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 450: rc = 0 00100000:10000000:3.0:1784403464.391053:0:15428:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 450: rc = 0 00100000:10000000:3.0:1784403464.391384:0:15428:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 450: rc = 0 00100000:10000000:3.0:1784403464.391770:0:15428:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 450: rc = 0 00100000:10000000:3.0:1784403464.392834:0:15428:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 450: rc = 0 00000020:00000080:3.0:1784403464.393613:0:15428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784403464.393626:0:15428:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784403464.393709:0:15428:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6828175665afb801 00000020:01000004:3.0:1784403464.393719:0:15428:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1784403464.393743:0:15428:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.128@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784403464.393747:0:15428:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784403464.393754:0:15428:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784403464.393759:0:15428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1784403464.393771:0:15428:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c8a527a0000) 00000020:00000080:3.0:1784403464.393781:0:15428:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1784403464.395069:0:15428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784403464.395224:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1784403464.395229:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1784403464.396088:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1784403464.396095:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784403464.396384:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784403464.396390:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1784403464.397673:0:15428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784403464.397843:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1784403464.397848:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1784403464.398387:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1784403464.398394:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00080000:1.0:1784403464.415470:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784403464.415478:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784403464.415482:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784403464.415484:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784403464.415631:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:001064a9-3cb5-489b-ba0a-bb457082004b:3566:1871082260885760:0@lo:400:kworker.0 00000100:00100000:0.0:1784403464.415715:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403464.415832:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260885888:0@lo:400:kworker.0 00000100:00100000:0.0:1784403464.415890:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403464.415963:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260885888 00000100:00100000:0.0:1784403464.415972:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260885888 00000100:00100000:0.0:1784403464.416025:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784403464.416035:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260885888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403464.416093:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260885888:12345-0@lo:400:kworker.0 Request processed in 58us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403464.416102:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784403464.416151:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c8a7ae7ea00 x1871082260885888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403464.416167:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260885888:0@lo:400:kworker.0 00000100:00100000:2.0:1784403464.416381:0:15428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784403464.416547:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260885760 00000100:00100000:1.0:1784403464.416552:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260885760 00000100:00100000:1.0:1784403464.416589:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784403464.416597:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+12:3566:x1871082260885760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403464.416623:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784403464.416630:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784403464.416637:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+12:3566:x1871082260885760:12345-0@lo:400:kworker.0 Request processed in 42us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403464.416644:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784403464.417128:0:3564:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784403454/real 1784403454] req@ffff8c8a7ae7f480 x1871082260882304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784403464 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403464.417150:0:3564:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c8a7ae7f480 x1871082260882304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784403464 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403464.417160:0:3564:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784403454/real 1784403454] req@ffff8c8a7ae7d880 x1871082260882176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784403464 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403464.417171:0:3564:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c8a7ae7d880 x1871082260882176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784403464 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784403464.417185:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784403464.417199:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784403464.417209:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260882304:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1784403464.417214:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b37b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784403464.417219:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784403464.417222:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260882176:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1784403464.417253:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784403464.417257:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784403464.417259:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b37b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784403464.417264:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:3.0:1784403464.417268:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784403464.417272:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c8a7b37b800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1784403464.417307:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a73604380 x1871082260886016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784403464.417323:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784403464.417326:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784403464.417327:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784403464.417330:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:3.0:1784403464.417332:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784403464.417336:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c8a52cc7800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1784403464.417347:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a73605c00 x1871082260886144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784403464.417367:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260886016:0@lo:8:kworker.0 00000100:00100000:3.0:1784403464.417456:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403464.417501:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260886144:0@lo:8:kworker.0 00000100:00100000:2.0:1784403464.418475:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784403464.418485:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784403464.418895:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403464.419345:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260886016 00000100:00100000:0.0:1784403464.419356:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260886016 00000100:00100000:0.0:1784403464.419389:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260886144 00000100:00100000:0.0:1784403464.419393:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260886144 00000100:00100000:0.0:1784403464.419408:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784403464.419416:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260886016:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784403464.419437:0:15429:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784403464.419496:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260886016:12345-0@lo:8:kworker.0 Request processed in 79us (2040us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784403464.419526:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784403464.419545:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403464.419551:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7744aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260886144:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784403464.419561:0:15429:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784403464.419591:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7744aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260886144:12345-0@lo:8:kworker.0 Request processed in 39us (697us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784403464.419599:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784403464.420060:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:001064a9-3cb5-489b-ba0a-bb457082004b:3566:1871082260885760:0@lo:400:kworker.0 00000100:00080000:2.0:1784403464.420348:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b37b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784403464.420354:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784403464.420359:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260886016:0@lo:8:kworker.0 00000100:00080000:2.0:1784403464.420468:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784403464.420473:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784403464.420476:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260886144:0@lo:8:kworker.0 00000100:00100000:1.0:1784403464.422029:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784403464.422041:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1784403464.426132:0:15428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784403464.426330:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1784403464.426338:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1784403464.427327:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1784403464.427337:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1784403464.495187:0:15428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784403464.495469:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784403464.495476:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1784403464.497430:0:15428:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1784403464.497444:0:15428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784403464.498119:0:15428:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784403464.498144:0:15428:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1784403464.498152:0:15428:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784403464.509769:0:15428:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784403464.509814:0:15428:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.128@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1784403464.509818:0:15428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784403464.509820:0:15428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784403464.509821:0:15428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403464.509822:0:15428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403464.509823:0:15428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403464.509824:0:15428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403464.509826:0:15428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403464.509835:0:15428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403464.509836:0:15428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784403464.509840:0:15428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1784403464.509842:0:15428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784403464.509843:0:15428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784403464.509844:0:15428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403464.509845:0:15428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403464.509846:0:15428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403464.509847:0:15428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403464.509848:0:15428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403464.509848:0:15428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403464.509849:0:15428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784403464.509901:0:15428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784403464.509925:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784403464.510014:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403464.510944:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce540 going to sleep for 11 seconds 00000100:00100000:0.0:1784403464.511035:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260886272 00000100:00100000:0.0:1784403464.511043:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260886272 00000100:00100000:1.0:1784403464.511347:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784403464.511358:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:15428:x1871082260886272:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784403464.511398:0:14789:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784403464.511401:0:14789:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1784403464.511405:0:14789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784403464.521531:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:15428:x1871082260886272:12345-0@lo:253:mount.lustre.0 Request processed in 10163us (11505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403464.521547:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784403464.521618:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886272:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784403464.521637:0:15428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784403464.521641:0:15428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784403464.521643:0:15428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784403464.521644:0:15428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403464.521646:0:15428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403464.521647:0:15428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403464.521649:0:15428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403464.521650:0:15428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403464.521653:0:15428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403464.521654:0:15428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784403464.521680:0:15428:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c8a5270a000 from lustre-OST0000 10000000:01000000:2.0:1784403464.521726:0:15428:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1784403464.521730:0:15428:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1784403464.521738:0:15428:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c8a72e419c0 local copy 00010000:00010000:2.0:1784403464.521748:0:15428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb6fe expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403464.522039:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784403464.522101:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403464.522121:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260886400 00000100:00100000:2.0:1784403464.522127:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c89410ce600 going to sleep for 11 seconds 00000100:00100000:1.0:1784403464.522127:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260886400 00000100:00100000:1.0:1784403464.522166:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784403464.522175:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:15428:x1871082260886400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784403464.522495:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+12:15428:x1871082260886400:12345-0@lo:501:mount.lustre.0 Request processed in 320us (392us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784403464.522503:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784403464.522558:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886400:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784403464.522579:0:15428:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784403464.522916:0:15428:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784403464.522925:0:15428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb6fe expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.522935:0:15428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb6fe expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403464.522960:0:15428:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c8a5270a000 10000000:01000000:3.0:1784403464.522964:0:15428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784403464.522969:0:15428:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c8a72e419c0 10000000:01000000:3.0:1784403464.522971:0:15428:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784403464.522975:0:15428:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8c8a72e419c0 from 1 10000000:01000000:3.0:1784403464.522977:0:15428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784403464.523003:0:15428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afb80f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.523011:0:15428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afb80f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.523121:0:15428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afb80f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403464.523139:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784403464.523177:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403464.523354:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4317af00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403464.523568:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260886528 00000100:00100000:2.0:1784403464.523573:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260886528 00000100:00100000:2.0:1784403464.523636:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784403464.523644:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+12:15428:x1871082260886528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784403464.523654:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403464.523668:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b2600/0x6828175665afb816 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb80f expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403464.523687:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b2600/0x6828175665afb816 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb80f expref: 13 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403464.523695:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b2600/0x6828175665afb816 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb80f expref: 13 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403464.523705:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2600, rc 0) 00000100:00100000:2.0:1784403464.523741:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+13:15428:x1871082260886528:12345-0@lo:101:mount.lustre.0 Request processed in 98us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403464.523748:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784403464.523778:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784403464.523792:0:15428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afb80f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb816 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.523811:0:15428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afb80f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb816 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403464.523829:0:15428:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784403464.523909:0:15428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afb80f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb816 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.523917:0:15428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6600/0x6828175665afb80f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb816 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403464.523924:0:15428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784403464.523928:0:15428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784403464.523934:0:15428:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784403464.523936:0:15428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784403464.523953:0:15428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb81d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.523964:0:15428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb81d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.523971:0:15428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb81d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403464.523985:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784403464.524010:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403464.524138:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4317af00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403464.524142:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260886656 00000100:00100000:1.0:1784403464.524147:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260886656 00000100:00100000:1.0:1784403464.524178:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784403464.524185:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+13:15428:x1871082260886656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784403464.524193:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403464.524202:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a734a0800/0x6828175665afb824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb81d expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.524217:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a734a0800/0x6828175665afb824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb81d expref: 14 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.524226:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a734a0800/0x6828175665afb824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb81d expref: 14 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.524233:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0800, rc 0) 00000100:00100000:1.0:1784403464.524268:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+14:15428:x1871082260886656:12345-0@lo:101:mount.lustre.0 Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403464.524274:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784403464.524462:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784403464.524473:0:15428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb81d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb824 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.524487:0:15428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb81d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb824 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784403464.526530:0:15428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784403464.528324:0:15428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784403464.528709:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784403464.528749:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784403464.528958:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784403464.529013:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784403464.529044:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784403464.529137:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784403464.529196:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784403464.529203:0:15428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784403464.529312:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784403464.529455:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403464.529495:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4317a480 going to sleep for 11 seconds 00000100:00100000:0.0:1784403464.529641:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260886784 00000100:00100000:0.0:1784403464.529649:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260886784 00000100:00100000:0.0:1784403464.529702:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784403464.529711:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+14:15428:x1871082260886784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784403464.530185:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+14:15428:x1871082260886784:12345-0@lo:501:mount.lustre.0 Request processed in 474us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403464.530193:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784403464.530601:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784403464.530640:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784403464.530683:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403464.530714:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4317a480 going to sleep for 11 seconds 00000100:00100000:1.0:1784403464.530843:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260886912 00000100:00100000:1.0:1784403464.530848:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260886912 00000100:00100000:1.0:1784403464.530909:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784403464.530917:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+14:15428:x1871082260886912:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784403464.531533:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+14:15428:x1871082260886912:12345-0@lo:503:mount.lustre.0 Request processed in 613us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403464.531541:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784403464.532478:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260886912:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784403464.533440:0:15428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784403464.533532:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784403464.533618:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403464.533708:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4317a480 going to sleep for 11 seconds 00000100:00100000:2.0:1784403464.533982:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260887040 00000100:00100000:2.0:1784403464.533990:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260887040 00000100:00100000:2.0:1784403464.534078:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784403464.534089:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+14:15428:x1871082260887040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784403464.534544:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+14:15428:x1871082260887040:12345-0@lo:502:mount.lustre.0 Request processed in 455us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403464.534553:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784403464.534618:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784403464.535201:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784403464.535260:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784403464.536320:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784403464.536399:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784403464.536439:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784403464.536474:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784403464.536538:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784403464.536576:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784403464.536626:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1784403464.536679:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1784403464.536716:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1784403464.536774:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1784403464.537000:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784403464.537147:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403464.537241:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a4317a480 going to sleep for 11 seconds 00000100:00100000:1.0:1784403464.537299:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260887168 00000100:00100000:1.0:1784403464.537308:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260887168 00000100:00100000:1.0:1784403464.537416:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784403464.537427:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+14:15428:x1871082260887168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784403464.537651:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+14:15428:x1871082260887168:12345-0@lo:502:mount.lustre.0 Request processed in 226us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403464.537659:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784403464.537750:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784403464.537849:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1784403464.537902:0:15428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1784403464.539128:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784403464.539152:0:15444:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1784403464.539161:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784403464.539163:0:15444:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784403464.539169:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784403464.539198:0:15444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c8a506d4d40) 00000020:00000080:2.0:1784403464.539223:0:15444:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784403464.539232:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784403464.539332:0:15444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a5270a000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784403464.539340:0:15444:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784403464.539353:0:15444:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6828175665afb832 00010000:00010000:2.0:1784403464.543486:0:15444:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1784403464.544230:0:15444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1784403464.546560:0:15444:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1784403464.548151:0:15444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1784403464.548165:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784403464.548173:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403464.548175:0:15444:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1784403464.548181:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784403464.548184:0:15444:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1784403464.548185:0:15444:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784403464.548187:0:15444:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784403464.548189:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784403464.548191:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403464.548193:0:15444:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784403464.548196:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784403464.548207:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403464.548208:0:15444:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784403464.548213:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784403464.548215:0:15444:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784403464.548217:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784403464.548220:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403464.548221:0:15444:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784403464.548224:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784403464.548226:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403464.548228:0:15444:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784403464.548231:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784403464.548305:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784403464.548310:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784403464.548311:0:15444:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784403464.548314:0:15444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1784403464.548472:0:15428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1784403464.548503:0:15428:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784403464.548525:0:15428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb81d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb824 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403464.548549:0:15428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7600/0x6828175665afb81d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb824 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403464.548557:0:15428:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a5270a000 from 1 10000000:01000000:0.0:1784403464.548560:0:15428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784403464.548598:0:15428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403464.548606:0:15428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403464.548617:0:15428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403464.548643:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784403464.548714:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403464.548761:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9000 going to sleep for 11 seconds 00000100:00100000:3.0:1784403464.548948:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260887296 00000100:00100000:3.0:1784403464.548956:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260887296 00000100:00100000:3.0:1784403464.549037:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784403464.549047:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+14:15428:x1871082260887296:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784403464.549072:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403464.549086:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afb840 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb839 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.549111:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afb840 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb839 expref: 15 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.549122:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afb840 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb839 expref: 15 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403464.549131:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7e00, rc 0) 00000100:00100000:3.0:1784403464.549172:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260887296:12345-0@lo:101:mount.lustre.0 Request processed in 126us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403464.549189:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784403464.550475:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784403464.550503:0:15428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403464.550515:0:15428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784403464.551519:0:15428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1784403464.553936:0:15428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784403464.554345:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1784403464.554392:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1784403464.554460:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1784403464.554469:0:15428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1784403464.554562:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784403464.554635:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403464.554686:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d3e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784403464.554948:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260887424 00000100:00100000:0.0:1784403464.554956:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260887424 00000100:00100000:0.0:1784403464.554998:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784403464.555020:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260887424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784403464.555636:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260887424:12345-0@lo:501:mount.lustre.0 Request processed in 617us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403464.555644:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784403464.555919:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784403464.555960:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784403464.556000:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403464.556027:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d3e240 going to sleep for 11 seconds 00000100:00100000:2.0:1784403464.556152:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260887552 00000100:00100000:2.0:1784403464.556157:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260887552 00000100:00100000:2.0:1784403464.556192:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784403464.556198:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260887552:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784403464.556356:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260887552:12345-0@lo:503:mount.lustre.0 Request processed in 157us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403464.556362:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784403464.556462:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887552:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784403464.557232:0:15428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784403464.557318:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784403464.557373:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403464.557450:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403464.558144:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260887680 00000100:00100000:1.0:1784403464.558153:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260887680 00000100:00100000:1.0:1784403464.558231:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784403464.558241:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260887680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784403464.558475:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260887680:12345-0@lo:502:mount.lustre.0 Request processed in 234us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403464.558482:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784403464.558575:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784403464.558900:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1784403464.558956:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1784403464.559005:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1784403464.559044:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1784403464.559095:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1784403464.559161:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1784403464.559197:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1784403464.559226:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1784403464.559262:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784403464.559323:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403464.561665:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403464.561753:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260887808 00000100:00100000:3.0:1784403464.561762:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260887808 00000100:00100000:3.0:1784403464.561931:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784403464.561942:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260887808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784403464.562320:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260887808:12345-0@lo:502:mount.lustre.0 Request processed in 378us (2995us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403464.562328:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784403464.562510:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784403464.562681:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1784403464.562701:0:15428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1784403464.564317:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784403464.564332:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403464.564342:0:15448:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784403464.564351:0:15448:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a5270a000 00000020:00000080:0.0:1784403464.564354:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784403464.564360:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403464.564363:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403464.564364:0:15448:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784403464.564367:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784403464.564369:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403464.564371:0:15448:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784403464.564374:0:15448:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a5270a000 00000020:00000080:0.0:1784403464.564376:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784403464.564475:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403464.564480:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403464.564481:0:15448:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784403464.564484:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784403464.564486:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403464.564488:0:15448:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784403464.564491:0:15448:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c8a5270a000 00000020:00000080:0.0:1784403464.564493:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784403464.567992:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784403464.568004:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784403464.568007:0:15448:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784403464.568013:0:15448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1784403464.568162:0:15428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1784403464.568195:0:15428:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784403464.568217:0:15428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.568228:0:15428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403464.568296:0:15428:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784403464.568299:0:15428:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c8a5270a000 10000000:01000000:1.0:1784403464.568303:0:15428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c8a5270a000 10000000:01000000:1.0:1784403464.568308:0:15428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784403464.568313:0:15428:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a5270a000 from 1 10000000:01000000:1.0:1784403464.568316:0:15428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784403464.568358:0:15428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a734a0e00/0x6828175665afb847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.568366:0:15428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a734a0e00/0x6828175665afb847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.568379:0:15428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a734a0e00/0x6828175665afb847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403464.568406:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784403464.568475:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403464.568531:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d3e480 going to sleep for 11 seconds 00000100:00100000:0.0:1784403464.568642:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260887936 00000100:00100000:0.0:1784403464.568650:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260887936 00000100:00100000:0.0:1784403464.568697:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784403464.568707:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260887936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784403464.568721:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403464.568736:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb84e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb847 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403464.568759:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb847 expref: 16 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403464.568776:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce4400/0x6828175665afb84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb847 expref: 16 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403464.568785:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4400, rc 0) 00000100:00100000:0.0:1784403464.568976:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:15428:x1871082260887936:12345-0@lo:101:mount.lustre.0 Request processed in 269us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403464.568984:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784403464.569137:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260887936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784403464.569153:0:15428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a734a0e00/0x6828175665afb847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb84e expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.569163:0:15428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a734a0e00/0x6828175665afb847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb84e expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784403464.569959:0:15428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1784403464.571973:0:15428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784403464.573358:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1784403464.573416:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1784403464.573452:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1784403464.573500:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1784403464.573538:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1784403464.573605:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1784403464.573643:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1784403464.573674:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1784403464.573720:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1784403464.573754:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1784403464.573786:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1784403464.574743:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1784403464.574779:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1784403464.574924:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1784403464.574974:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1784403464.575010:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1784403464.575039:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1784403464.575083:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1784403464.575119:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1784403464.575153:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1784403464.575198:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1784403464.575250:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1784403464.577569:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1784403464.577714:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1784403464.577751:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1784403464.577783:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1784403464.577848:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1784403464.577917:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1784403464.578012:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1784403464.578020:0:15428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1784403464.578135:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260888064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784403464.578203:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403464.578254:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d3e480 going to sleep for 11 seconds 00000100:00100000:3.0:1784403464.579061:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260888064 00000100:00100000:3.0:1784403464.579072:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260888064 00000100:00100000:3.0:1784403464.579126:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784403464.579137:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+16:15428:x1871082260888064:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784403464.579439:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+16:15428:x1871082260888064:12345-0@lo:501:mount.lustre.0 Request processed in 303us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403464.579447:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784403464.580719:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260888064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784403464.581608:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260888192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784403464.581690:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403464.581772:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d3e480 going to sleep for 11 seconds 00000100:00100000:3.0:1784403464.581929:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260888192 00000100:00100000:3.0:1784403464.581936:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260888192 00000100:00100000:3.0:1784403464.581982:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784403464.581990:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:15428:x1871082260888192:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784403464.582229:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:15428:x1871082260888192:12345-0@lo:503:mount.lustre.0 Request processed in 239us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403464.582237:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784403464.583644:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260888192:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784403464.584252:0:15428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784403464.584354:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260888320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784403464.584434:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403464.584487:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260888320 00000100:00100000:1.0:1784403464.584493:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260888320 00000100:00100000:1.0:1784403464.584535:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784403464.584544:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+16:15428:x1871082260888320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784403464.584751:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+16:15428:x1871082260888320:12345-0@lo:502:mount.lustre.0 Request processed in 207us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403464.584759:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784403464.584808:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d3e480 going to sleep for 11 seconds 00000100:00100000:1.0:1784403464.584833:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260888320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784403464.585096:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1784403464.585142:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1784403464.585175:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1784403464.585223:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1784403464.585262:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1784403464.585342:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1784403464.585376:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1784403464.585407:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1784403464.585451:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1784403464.585485:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1784403464.585518:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1784403464.585566:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1784403464.585602:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1784403464.585634:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1784403464.585679:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1784403464.585715:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1784403464.585750:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1784403464.585816:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1784403464.585858:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1784403464.585918:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1784403464.585965:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1784403464.586016:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1784403464.586052:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1784403464.586100:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1784403464.586137:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1784403464.586171:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1784403464.586220:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1784403464.586254:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1784403464.586303:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1784403464.586354:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1784403464.586390:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1784403464.586434:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1784403464.586471:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1784403464.586517:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1784403464.586553:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1784403464.586603:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1784403464.586640:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1784403464.586686:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1784403464.586737:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1784403464.586769:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1784403464.586813:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260888448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784403464.586901:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403464.586938:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d3e480 going to sleep for 11 seconds 00000100:00100000:3.0:1784403464.587237:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260888448 00000100:00100000:3.0:1784403464.587245:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260888448 00000100:00100000:3.0:1784403464.587312:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784403464.587324:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:15428:x1871082260888448:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784403464.587569:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:15428:x1871082260888448:12345-0@lo:502:mount.lustre.0 Request processed in 246us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403464.587577:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784403464.589142:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260888448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784403464.589673:0:15428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1784403464.589691:0:15428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1784403464.594750:0:15453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784403464.594770:0:15453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c8a506d19c0) 00000020:00000080:2.0:1784403464.595188:0:15453:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1784403464.595447:0:15453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a5270a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784403464.595452:0:15453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c8a5270a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784403464.595455:0:15453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a5270a000 3 00010000:00080000:2.0:1784403464.595489:0:15453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c8a7c768800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.128@tcp at head 00010000:00010000:2.0:1784403464.599610:0:15453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1784403464.599726:0:15453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784403464.599767:0:15453:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784403464.599786:0:15453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6828175665afb85c 00000100:00080000:2.0:1784403464.600174:0:15453:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784403464.600191:0:15453:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c8a7c768800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1784403464.600231:0:15453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a77448a80 x1871082260888576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784403464.600285:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3564:1871082260888576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784403464.600357:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784403464.600457:0:15453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1784403464.602360:0:15453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:3.0:1784403464.602817:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784403464.602824:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784403464.602828:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b37b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784403464.602836:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1784403464.602841:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784403464.602847:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c8a7b37b800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1784403464.602908:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a73604e00 x1871082260888704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784403464.602930:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784403464.602934:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784403464.602936:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784403464.602940:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1784403464.602943:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784403464.602947:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c8a52cc7800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1784403464.602958:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a73605180 x1871082260888832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784403464.603009:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260888704:0@lo:8:kworker.0 00000100:00100000:3.0:1784403464.603071:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403464.603102:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260888832:0@lo:8:kworker.0 00000100:00100000:3.0:1784403464.603127:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403464.603178:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260888960:0@lo:400:kworker.0 00000100:00100000:3.0:1784403464.603212:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1784403464.603582:0:15428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1784403464.603620:0:15428:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784403464.603644:0:15428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a734a0e00/0x6828175665afb847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb84e expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.603656:0:15428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a734a0e00/0x6828175665afb847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb84e expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784403464.603709:0:15428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784403464.603711:0:15428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784403464.603713:0:15428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403464.603714:0:15428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784403464.603715:0:15428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403464.603716:0:15428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403464.603718:0:15428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784403464.603720:0:15428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403464.603721:0:15428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784403464.603729:0:15428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1784403464.603731:0:15428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784403464.603732:0:15428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784403464.603733:0:15428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403464.603734:0:15428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784403464.603735:0:15428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403464.603736:0:15428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403464.603737:0:15428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784403464.603737:0:15428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403464.603738:0:15428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784403464.603756:0:15428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784403464.603768:0:15428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260889088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784403464.603821:0:15428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403464.603911:0:15428:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49d3e240 going to sleep for 11 seconds 00000100:00100000:2.0:1784403464.604477:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260889088 00000100:00100000:2.0:1784403464.604487:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260889088 00000100:00100000:3.0:1784403464.604526:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260888704 00000100:00100000:3.0:1784403464.604531:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260888704 00000100:00100000:2.0:1784403464.604532:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784403464.604541:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:15428:x1871082260889088:12345-0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784403464.604547:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260888832 00000100:00100000:3.0:1784403464.604550:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260888832 00000100:00100000:3.0:1784403464.604560:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784403464.604565:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260888704:12345-0@lo:8:kworker.0 20000000:01000000:2.0:1784403464.604571:0:14791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784403464.604584:0:14791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784403464.604624:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260888704:12345-0@lo:8:kworker.0 Request processed in 57us (1552us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784403464.604631:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784403464.604644:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784403464.604647:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260888832:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784403464.604656:0:15429:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784403464.604678:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260888832:12345-0@lo:8:kworker.0 Request processed in 29us (1550us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784403464.604682:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784403464.604723:0:3564:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784403464.604731:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b37b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784403464.604735:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784403464.604738:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260888704:0@lo:8:kworker.0 00000100:00080000:3.0:1784403464.604747:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784403464.604750:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784403464.604753:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260888832:0@lo:8:kworker.0 00000100:00100000:0.0:1784403464.605488:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260888576 00000100:00100000:0.0:1784403464.605496:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260888576 00000100:00100000:0.0:1784403464.605531:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260888960 00000100:00100000:0.0:1784403464.605535:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260888960 00000100:00100000:0.0:1784403464.605558:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403464.605565:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260888960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403464.605670:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260888960:12345-0@lo:400:kworker.0 Request processed in 104us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403464.605678:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403464.605693:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784403464.605697:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7744a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3564:x1871082260888576:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784403464.605716:0:14798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:0.0:1784403464.605754:0:14798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6828175665afb863 00000004:00100000:0.0:1784403464.605769:0:14798:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784403464.605808:0:14798:0:(import.c:65:import_set_state_nolock()) ffff8c8a7c664000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784403464.605853:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7744a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3564:x1871082260888576:12345-0@lo:38:llog_process_th.0 Request processed in 154us (5496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403464.605859:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784403464.606466:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c8a73605f80 x1871082260888960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403464.606480:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260888960:0@lo:400:kworker.0 00010000:00080000:3.0:1784403464.606617:0:3564:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c8a77448a80 x1871082260888576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784403474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403464.606626:0:3564:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784403464.606640:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1784403464.606649:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784403464.606654:0:3564:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784403464.606657:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a7c768800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784403464.606663:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3564:1871082260888576:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1784403464.641349:0:14791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784403464.641371:0:14791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1784403464.641839:0:14812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784403464.641846:0:14812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784403464.641894:0:14812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403464.641915:0:14812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afb7d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb7d0 expref: 16 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403464.641924:0:14812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403464.641989:0:14812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afb7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afb7d0 expref: 16 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403464.642003:0:14812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afb7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afb7d0 expref: 16 pid: 14789 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403464.642019:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14812:1871082260889216:0@lo:104: 00000100:00100000:2.0:1784403464.642100:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403464.642144:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a46a51cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403464.642218:0:14781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260889216 00000100:00100000:1.0:1784403464.642225:0:14781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260889216 00000100:00100000:1.0:1784403464.642270:0:14781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784403464.642295:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:001064a9-3cb5-489b-ba0a-bb457082004b+3:14812:x1871082260889216:12345-0@lo:104: 00010000:00010000:1.0:1784403464.642308:0:14781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642371:0:14781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784403464.642377:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:001064a9-3cb5-489b-ba0a-bb457082004b+3:14812:x1871082260889216:12345-0@lo:104: Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403464.642384:0:14781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1784403464.642406:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403464.642412:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642420:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1800 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403464.642425:0:14786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642444:0:14786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403464.642452:0:14786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403464.642458:0:14786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784403464.642489:0:14786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642495:0:14786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403464.642515:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642522:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1800/0x6828175665afb7d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb7d7 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642537:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403464.642539:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403464.642541:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403464.642559:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784403464.642569:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:001064a9-3cb5-489b-ba0a-bb457082004b:3566:1871082260889344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403464.642597:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403464.642630:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260889344 00000100:00100000:1.0:1784403464.642634:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260889344 00010000:00010000:1.0:1784403464.642651:0:14784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afb7d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb7d0 expref: 17 pid: 14789 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403464.642673:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784403464.642687:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:001064a9-3cb5-489b-ba0a-bb457082004b+17:3566:x1871082260889344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403464.642696:0:14784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403464.642701:0:14784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afb7d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb7d0 expref: 17 pid: 14789 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642710:0:14784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afb7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afb7d0 expref: 17 pid: 14789 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642726:0:14784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642733:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784403464.642745:0:14784:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001885041s 00010000:00010000:1.0:1784403464.642749:0:14784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642757:0:14784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642763:0:14784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642768:0:14784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642774:0:14784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403464.642778:0:14784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642797:0:14784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642806:0:14784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403464.642815:0:14784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403464.642845:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:001064a9-3cb5-489b-ba0a-bb457082004b+17:3566:x1871082260889344:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403464.642852:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784403464.642932:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:001064a9-3cb5-489b-ba0a-bb457082004b:3566:1871082260889344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784403464.643448:0:14812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afb7d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afb7d0 expref: 16 pid: 14789 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403464.643460:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14812:1871082260889216:0@lo:104: 00010000:00010000:2.0:1784403464.643475:0:14812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403464.643483:0:14812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403464.643488:0:14812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403464.643494:0:14812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7b5b3600/0x6828175665afb86a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403464.651050:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+15:15428:x1871082260889088:12345-0@lo:253:mount.lustre.0 Request processed in 46500us (47218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403464.651165:0:15428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:15428:1871082260889088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784403464.651184:0:15428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784403464.651188:0:15428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784403464.651190:0:15428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784403464.651191:0:15428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403464.651192:0:15428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784403464.651193:0:15428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403464.651194:0:15428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403464.651196:0:15428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784403464.651198:0:15428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403464.651199:0:15428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784403464.651214:0:15428:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784403464.652131:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00080000:10000000:1.0:1784403464.655704:0:15428:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1784403464.656016:0:15428:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784403464.656193:0:15428:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1784403464.656361:0:15428:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784403464.656507:0:15428:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1784403464.656698:0:15428:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1784403464.657757:0:15428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784403464.703605:0:15428:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784403464.703614:0:15428:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784403464.703645:0:15428:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784403464.703705:0:15428:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784403464.703721:0:15428:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784403464.703751:0:15428:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1784403464.927965:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403465.951109:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784403466.336360:0:14794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784403466.336369:0:14794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c8a7303e800 from 7 10000000:01000000:2.0:1784403466.336374:0:14794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784403466.336426:0:14794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403466.336452:0:14794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403466.336465:0:14794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403466.336495:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260889472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784403466.336593:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403466.336657:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a49fbca80 going to sleep for 11 seconds 00000100:00100000:1.0:1784403466.338105:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260889472 00000100:00100000:1.0:1784403466.338761:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260889472 00000100:00100000:1.0:1784403466.338832:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784403466.338845:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+15:14794:x1871082260889472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403466.338863:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403466.338902:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a734a0400/0x6828175665afb878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb871 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403466.338931:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a734a0400/0x6828175665afb878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb871 expref: 16 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403466.338941:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a734a0400/0x6828175665afb878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb871 expref: 16 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403466.338949:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0400, rc 0) 00000100:00100000:1.0:1784403466.339020:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+16:14794:x1871082260889472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403466.339027:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784403466.342419:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260889472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403466.342450:0:14794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403466.342464:0:14794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403466.342539:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73605180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260889600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784403466.342604:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403466.342655:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a50321180 going to sleep for 11 seconds 00000100:00100000:1.0:1784403466.342788:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260889600 00000100:00100000:1.0:1784403466.342795:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260889600 00000100:00100000:1.0:1784403466.342848:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784403466.342859:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:14794:x1871082260889600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784403466.342901:0:14791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784403466.342917:0:14791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784403466.342920:0:14791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1784403466.343004:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:14794:x1871082260889600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403466.343011:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784403466.343055:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73605180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260889600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784403466.343124:0:14794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784403466.343132:0:14794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403466.343141:0:14794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784403466.399730:0:14830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784403466.977253:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403467.999320:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403469.024216:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784403470.050419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784403470.050428:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784403470.050433:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b37b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784403470.050446:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c8a7b37b800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1784403470.050472:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a7744b800 x1871082260889856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784403470.050494:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784403470.050498:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784403470.050499:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784403470.050504:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:2.0:1784403470.050509:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784403470.050515:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c8a52cc7800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1784403470.050530:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a77449880 x1871082260889984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784403470.050536:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:001064a9-3cb5-489b-ba0a-bb457082004b:3566:1871082260889728:0@lo:400:kworker.0 00000100:00100000:2.0:1784403470.050597:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260889856:0@lo:8:kworker.0 00000100:00100000:0.0:1784403470.050632:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784403470.050796:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403470.050827:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260889728 00000100:00100000:1.0:1784403470.050835:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260889728 00000100:00100000:1.0:1784403470.050898:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784403470.050910:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+16:3566:x1871082260889728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403470.054694:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+16:3566:x1871082260889728:12345-0@lo:400:kworker.0 Request processed in 3773us (4050us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403470.054711:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784403470.055069:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:001064a9-3cb5-489b-ba0a-bb457082004b:3566:1871082260889728:0@lo:400:kworker.0 00000100:00100000:2.0:1784403470.055518:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403470.055566:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260889984:0@lo:8:kworker.0 00000100:00100000:1.0:1784403470.056402:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260889856 00000100:00100000:1.0:1784403470.056413:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260889856 00000100:00100000:1.0:1784403470.056456:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784403470.056466:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3564:x1871082260889856:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784403470.056512:0:15429:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:1.0:1784403470.056547:0:15429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6828175665afb87f 00002000:00100000:1.0:1784403470.056563:0:15429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c8a7d194000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784403470.056580:0:15429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784403470.056583:0:15429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1784403470.058510:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403470.058583:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260890112:0@lo:400:kworker.0 00000100:00100000:2.0:1784403470.058620:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403470.058646:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403470.058654:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260890240:0@lo:400:kworker.0 00000100:00100000:2.0:1784403470.058684:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403470.058728:0:15431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784403470.058736:0:15431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784403470.058762:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260890112 00000100:00100000:2.0:1784403470.058770:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260890112 00000100:00100000:2.0:1784403470.058819:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260890240 00000100:00100000:2.0:1784403470.058822:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260890240 00000100:00100000:2.0:1784403470.058893:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784403470.058905:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260890112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403470.059048:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260890112:12345-0@lo:400:kworker.0 Request processed in 146us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403470.059056:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784403470.059076:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784403470.059083:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260890240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403470.059112:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260890240:12345-0@lo:400:kworker.0 Request processed in 31us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403470.059119:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1784403470.059245:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784403470.059275:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a7744b480 x1871082260890240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403470.059305:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260890240:0@lo:400:kworker.0 00010000:00080000:2.0:1784403470.059321:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a7744b100 x1871082260890112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403470.059331:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260890112:0@lo:400:kworker.0 00000100:00100000:2.0:1784403470.059372:0:15431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260889984 00000100:00100000:2.0:1784403470.059376:0:15431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260889984 00000100:00100000:2.0:1784403470.059446:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784403470.059451:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7744bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3564:x1871082260889984:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784403470.059467:0:15768:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00002000:00080000:1.0:1784403470.059796:0:15429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784403470.059831:0:15429:0:(import.c:65:import_set_state_nolock()) ffff8c8a7d193000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784403470.060042:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3564:x1871082260889856:12345-0@lo:8:kworker.0 Request processed in 3450us (4397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403470.060052:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784403470.060109:0:3564:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a7744b800 x1871082260889856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784403490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784403470.060124:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784403470.060133:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784403470.060139:0:3564:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784403470.060142:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a7b37b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784403470.060166:0:3564:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784403470.060172:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260889856:0@lo:8:kworker.0 00000004:00080000:1.0:1784403470.060241:0:14819:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1784403470.060259:0:14819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14819:1871082260890496:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784403470.060298:0:14819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403470.060324:0:14819:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a50321300 going to sleep for 11 seconds 00000100:00100000:1.0:1784403470.060342:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260890368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784403470.060372:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403470.060408:0:15431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260890496 00000100:00100000:1.0:1784403470.060412:0:15431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260890496 00000100:00100000:1.0:1784403470.060458:0:15431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403470.060466:0:15431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14819:x1871082260890496:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1784403470.060812:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403470.060850:0:15433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260890368 00000100:00100000:3.0:1784403470.060856:0:15433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260890368 00000100:00100000:3.0:1784403470.061795:0:15433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784403470.061806:0:15433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3565:x1871082260890368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784403470.061843:0:15433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403470.061939:0:15433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3565:x1871082260890368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403470.061948:0:15433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784403470.061965:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a7ae7c000 x1871082260890368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403470.061987:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260890368:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1784403470.075123:0:15431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1784403470.075152:0:15431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1784403470.075159:0:15431:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000004:00080000:3.0:1784403470.082954:0:14818:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784403470.083317:0:14818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 475651450001ns, next at 0ns, rc = 0 00002000:00010000:1.0:1784403470.087380:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403470.087394:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afb886 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.087412:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1784403470.087417:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403470.087424:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afb886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.087445:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afb886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.087457:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afb886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.087466:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afb886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.087494:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403470.087509:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.087515:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afb886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.087525:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1a00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.087530:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afb886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.087548:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afb886 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.087567:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afb886 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.087574:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afb886 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.087592:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.087594:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.087595:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403470.088186:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403470.088195:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b1ab10/0x6828175665afb88d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088205:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1784403470.088209:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403470.088214:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014b1ab10/0x6828175665afb88d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088225:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014b1ab10/0x6828175665afb88d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088233:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b1ab10/0x6828175665afb88d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088249:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014b1ab10/0x6828175665afb88d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088274:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784403470.088757:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403470.088764:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afb894 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088773:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.088776:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.088778:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403470.088786:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afb894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.088789:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014b1ab10/0x6828175665afb88d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088802:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afb894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.088804:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1200 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403470.088811:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b1ab10/0x6828175665afb88d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088817:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afb894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.088826:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b1ab10/0x6828175665afb88d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088829:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afb894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.088853:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014b1ab10/0x6828175665afb88d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088854:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403470.088889:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b1ab10/0x6828175665afb88d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.088891:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403470.088913:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403470.088916:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403470.088918:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403470.089851:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403470.089985:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073258813/0x6828175665afb89b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.090000:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1784403470.090004:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403470.090009:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073258813/0x6828175665afb89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.090020:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073258813/0x6828175665afb89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.090029:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073258813/0x6828175665afb89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.090036:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073258813/0x6828175665afb89b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.090061:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403470.090203:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403470.090211:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073258813/0x6828175665afb89b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.090220:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403470.090225:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073258813/0x6828175665afb89b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.090246:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073258813/0x6828175665afb89b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.090263:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073258813/0x6828175665afb89b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.090271:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073258813/0x6828175665afb89b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.090291:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403470.090292:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403470.090294:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403470.092252:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403470.092258:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.092260:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afb894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.092261:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.092276:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.092282:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afb894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.092291:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afb894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.092332:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afb894 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.092340:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afb894 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.092435:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.092439:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.092441:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403470.093548:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403470.093559:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e98fbcc3/0x6828175665afb8a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.093574:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1784403470.093580:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403470.093586:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e98fbcc3/0x6828175665afb8a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.093598:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e98fbcc3/0x6828175665afb8a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.093607:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e98fbcc3/0x6828175665afb8a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.093614:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e98fbcc3/0x6828175665afb8a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.093648:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784403470.094271:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403470.094279:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003035a996/0x6828175665afb8a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.094290:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1784403470.094294:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403470.094298:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003035a996/0x6828175665afb8a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.094309:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003035a996/0x6828175665afb8a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.094318:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003035a996/0x6828175665afb8a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.094326:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003035a996/0x6828175665afb8a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.094430:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784403470.098666:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403470.098683:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e98fbcc3/0x6828175665afb8a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.098699:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.098723:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e98fbcc3/0x6828175665afb8a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.098735:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e98fbcc3/0x6828175665afb8a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.098759:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e98fbcc3/0x6828175665afb8a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.098768:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e98fbcc3/0x6828175665afb8a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.098797:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.098800:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003035a996/0x6828175665afb8a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.098806:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0a00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.098809:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003035a996/0x6828175665afb8a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.098816:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003035a996/0x6828175665afb8a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.098825:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003035a996/0x6828175665afb8a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.098833:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003035a996/0x6828175665afb8a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.098854:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.098856:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.098857:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403470.099555:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403470.099563:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000babdbf33/0x6828175665afb8b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.099577:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1784403470.099583:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403470.099590:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000babdbf33/0x6828175665afb8b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.099602:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000babdbf33/0x6828175665afb8b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.099612:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000babdbf33/0x6828175665afb8b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.099620:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000babdbf33/0x6828175665afb8b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.099648:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403470.099660:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.099665:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000babdbf33/0x6828175665afb8b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.099683:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.099687:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000babdbf33/0x6828175665afb8b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.099695:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000babdbf33/0x6828175665afb8b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.099707:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000babdbf33/0x6828175665afb8b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.099714:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000babdbf33/0x6828175665afb8b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.099729:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.099731:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.099733:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403470.100216:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403470.100224:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3df282/0x6828175665afb8b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100234:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1784403470.100237:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403470.100242:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3df282/0x6828175665afb8b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100251:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b3df282/0x6828175665afb8b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100266:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3df282/0x6828175665afb8b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100274:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b3df282/0x6828175665afb8b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100285:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784403470.100709:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403470.100716:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb8be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100725:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1784403470.100729:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403470.100733:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb8be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100743:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb8be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100751:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb8be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100758:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb8be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100789:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784403470.100802:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403470.100807:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b3df282/0x6828175665afb8b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100813:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.100816:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3df282/0x6828175665afb8b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100824:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3df282/0x6828175665afb8b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100838:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b3df282/0x6828175665afb8b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100845:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b3df282/0x6828175665afb8b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100863:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.100889:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb8be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100895:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0000 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.100898:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb8be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100916:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb8be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100928:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb8be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100934:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008eb7c8ad/0x6828175665afb8be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.100946:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.100948:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.100950:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403470.106236:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7744bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3564:x1871082260889984:12345-0@lo:8:kworker.0 Request processed in 46775us (47725us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784403470.106251:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1784403470.106508:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784403470.106516:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784403470.106521:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260889984:0@lo:8:kworker.0 00002000:00010000:3.0:1784403470.106660:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.106669:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb8c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.106686:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.106690:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.106697:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb8c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.106712:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb8c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.106731:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb8c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.106739:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb8c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.106766:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403470.106814:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.106821:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb8c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.106831:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.106836:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb8c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.106847:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb8c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.107088:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb8c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.107096:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a1926cc/0x6828175665afb8c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.107115:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.107117:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.107119:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.107277:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.107283:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb8cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.107293:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.107296:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.107301:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb8cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.107311:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb8cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.107319:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb8cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.107327:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb8cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.107358:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403470.107385:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.107392:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb8cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.107401:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7a00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.107405:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb8cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.107423:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb8cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.107436:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb8cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.107443:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb8cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.107474:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.107476:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.107478:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.107839:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.107846:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb8d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108053:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.108059:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.108064:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb8d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108075:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb8d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108084:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb8d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108091:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb8d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108111:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403470.108197:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.108204:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb8d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.108213:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.108217:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb8d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.108223:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.108226:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb8d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.108242:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb8d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.108249:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb8d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.108266:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.108269:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.108272:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.108574:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.108580:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108589:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.108597:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.108603:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108613:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108621:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108627:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108643:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403470.108653:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403470.108658:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108665:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7200 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403470.108668:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108676:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108687:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108706:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.108720:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403470.108721:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403470.108723:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.109153:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.109160:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb8e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.109170:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1784403470.113077:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403470.113759:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.113774:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb8e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.113798:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb8e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.113811:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb8e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.113820:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb8e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.115920:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784403470.116917:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.116933:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb8e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.116951:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.116966:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.116973:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb8e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.116988:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb8e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.116999:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb8e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.117008:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb8e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.117034:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784403470.117089:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403470.117094:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403470.117099:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb8e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.117103:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb8e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.117116:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6e00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403470.117122:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb8e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.117147:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6000 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403470.117148:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb8e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.117152:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb8e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.117167:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb8e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.117198:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb8e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.117198:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb8e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.117225:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb8e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.117225:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb8e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.117274:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.117274:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.117279:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.117280:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.117285:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.117286:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.117554:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.117561:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afb8ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.117570:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.117574:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.117578:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afb8ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.117588:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afb8ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.117605:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afb8ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.117612:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afb8ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.117635:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784403470.118014:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.118021:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa0faeb8/0x6828175665afb8f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.118030:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.118033:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.118037:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa0faeb8/0x6828175665afb8f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.118046:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa0faeb8/0x6828175665afb8f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.118053:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa0faeb8/0x6828175665afb8f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.118060:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa0faeb8/0x6828175665afb8f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.118085:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784403470.118915:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403470.118924:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afb8ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.118935:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7000 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.118939:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afb8ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.118949:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afb8ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.118977:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afb8ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.118985:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afb8ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.119000:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.119004:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa0faeb8/0x6828175665afb8f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.119011:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.119014:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa0faeb8/0x6828175665afb8f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.119022:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa0faeb8/0x6828175665afb8f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.119032:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa0faeb8/0x6828175665afb8f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.119039:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa0faeb8/0x6828175665afb8f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.119049:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.119051:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.119060:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.121344:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.123248:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.123261:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.123279:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.123284:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.123291:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.123307:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.123318:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.123327:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.123358:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784403470.123423:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784403470.123433:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403470.123445:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7200 already unused, calling callback (ffffffffc149a230) 00010000:00010000:2.0:1784403470.123450:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403470.123460:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403470.123485:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403470.123682:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000414631b1/0x6828175665afb8fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403470.123706:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403470.123709:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403470.123711:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.123842:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.123849:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afb904 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.123899:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.123908:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.123913:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afb904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.123923:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afb904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.123932:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afb904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.123939:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afb904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.123958:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403470.124149:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.124157:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afb904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.124167:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.124182:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afb904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.124193:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afb904 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.124208:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afb904 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.124217:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f91ebb2a/0x6828175665afb904 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.124233:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.124234:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.124236:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.124430:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.124437:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afb90b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.124446:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.124449:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.124453:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afb90b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.124462:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afb90b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.124469:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afb90b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.124482:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afb90b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.124502:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784403470.124935:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.124941:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61ad1ec/0x6828175665afb912 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.124950:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.124953:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.124958:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d61ad1ec/0x6828175665afb912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.124968:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d61ad1ec/0x6828175665afb912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.124975:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61ad1ec/0x6828175665afb912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.124982:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d61ad1ec/0x6828175665afb912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.125001:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784403470.125003:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403470.125011:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afb90b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.125021:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6200 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.125025:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afb90b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.125047:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afb90b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.125062:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afb90b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.125069:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d006aa/0x6828175665afb90b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.125085:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.125088:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d61ad1ec/0x6828175665afb912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.125094:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.125097:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61ad1ec/0x6828175665afb912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.125105:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61ad1ec/0x6828175665afb912 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.125114:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d61ad1ec/0x6828175665afb912 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.125121:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d61ad1ec/0x6828175665afb912 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.125145:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.125148:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.125151:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784403470.125405:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.129733:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.129745:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000151d33b2/0x6828175665afb919 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.129767:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.129772:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.129778:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000151d33b2/0x6828175665afb919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.129794:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000151d33b2/0x6828175665afb919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.129804:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000151d33b2/0x6828175665afb919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.129813:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000151d33b2/0x6828175665afb919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.129840:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403470.130258:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.130267:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000151d33b2/0x6828175665afb919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.130278:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.130284:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000151d33b2/0x6828175665afb919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.130295:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000151d33b2/0x6828175665afb919 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.130377:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000151d33b2/0x6828175665afb919 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.130385:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000151d33b2/0x6828175665afb919 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.130423:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.130426:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.130430:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.136692:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.136706:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e4bc6f/0x6828175665afb920 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.136724:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.136730:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.136736:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e4bc6f/0x6828175665afb920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.136752:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e4bc6f/0x6828175665afb920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.136776:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e4bc6f/0x6828175665afb920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.136785:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e4bc6f/0x6828175665afb920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.136818:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403470.136861:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.136885:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e4bc6f/0x6828175665afb920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.136905:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6a00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.136910:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e4bc6f/0x6828175665afb920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.136919:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e4bc6f/0x6828175665afb920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784403470.137590:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.137598:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb927 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.137610:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.137614:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.137619:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.137630:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.137639:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.137646:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.137681:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784403470.137707:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403470.137715:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.137726:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6000 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403470.137731:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.137740:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.137759:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb927 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.137768:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea874bd/0x6828175665afb927 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.137802:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.137804:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.137806:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.138231:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.138240:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb92e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.138252:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.138256:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.138261:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb92e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.138272:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb92e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.138280:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb92e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.138287:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb92e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.138306:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784403470.138317:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403470.138323:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb92e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.138332:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6e00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403470.138336:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb92e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.138345:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb92e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.138357:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb92e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.138365:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c20de48/0x6828175665afb92e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.138383:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.138385:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.138387:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.138748:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.138755:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb935 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.138764:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.138774:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.138779:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.138788:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.138797:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.138804:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.138827:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403470.139520:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e4bc6f/0x6828175665afb920 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.139529:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e4bc6f/0x6828175665afb920 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.139546:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403470.139555:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.139564:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce6c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403470.139568:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.139575:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb935 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.139585:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb935 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.139599:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed4f0a0/0x6828175665afb935 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403470.139611:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.139613:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403470.139615:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.141817:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784403470.142091:0:15431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403470.142103:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb93c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.142119:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1784403470.142124:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403470.142131:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb93c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.142145:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb93c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.142155:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb93c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.142183:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb93c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403470.142208:0:15431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784403470.142245:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403470.142253:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb93c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.142271:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7a00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403470.142276:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb93c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.142285:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb93c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.142304:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb93c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.142312:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f40e5b3/0x6828175665afb93c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403470.142332:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.142335:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403470.142337:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784403470.143938:0:15431:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1784403470.144325:0:14819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14819:1871082260890496:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784403470.144343:0:14819:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1784403470.144392:0:14819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943274000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14819:1871082260890624:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784403470.145452:0:15431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14819:x1871082260890496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 84980us (85148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403470.145466:0:15431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784403470.145528:0:14819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403470.145602:0:14819:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586e9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784403470.148069:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260890624 00000100:00100000:3.0:1784403470.148084:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260890624 00000100:00100000:3.0:1784403470.148143:0:15430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784403470.148155:0:15430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943277480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14819:x1871082260890624:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784403470.148222:0:15430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:2.0:1784403470.148224:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784403470.156476:0:15430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943277480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14819:x1871082260890624:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8314us (10939us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784403470.156492:0:15430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784403470.156711:0:14819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943274000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14819:1871082260890624:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784403470.156732:0:14819:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:02000400:1.0:1784403470.378136:0:15799:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784403471.074525:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403472.100802:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403473.121992:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403474.145145:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403475.168227:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260890752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784403475.168323:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403475.168442:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260890752 00000100:00100000:0.0:1784403475.168452:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260890752 00000100:00100000:0.0:1784403475.168515:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403475.168529:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3566:x1871082260890752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784403475.168568:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784403475.168782:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3566:x1871082260890752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403475.168789:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1784403475.168813:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403475.168917:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260890752:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784403475.170217:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784403475.170224:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784403475.170229:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784403475.170236:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:3.0:1784403475.170242:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784403475.170248:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c8a52cc7800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1784403475.170336:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a73607480 x1871082260891008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784403475.170422:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260891136:0@lo:400:kworker.0 00000100:00100000:3.0:1784403475.170499:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403475.170534:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784403475.170541:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:001064a9-3cb5-489b-ba0a-bb457082004b:3568:1871082260890880:0@lo:400:kworker.0 00000100:00100000:3.0:1784403475.170572:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403475.170832:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260891008:0@lo:8:kworker.0 00000100:00100000:3.0:1784403475.170892:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403475.170937:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260891136 00000100:00100000:3.0:1784403475.170945:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260891136 00000100:00100000:3.0:1784403475.170993:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784403475.171002:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260891136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403475.171068:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260891136:12345-0@lo:400:kworker.0 Request processed in 67us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403475.171075:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784403475.171122:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260890880 00000100:00100000:3.0:1784403475.171126:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260890880 00000100:00100000:3.0:1784403475.171153:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784403475.171160:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+16:3568:x1871082260890880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403475.171189:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+16:3568:x1871082260890880:12345-0@lo:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403475.171194:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784403475.171245:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:001064a9-3cb5-489b-ba0a-bb457082004b:3568:1871082260890880:0@lo:400:kworker.0 00010000:00080000:3.0:1784403475.171274:0:3568:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a73606300 x1871082260891136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403475.171287:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260891136:0@lo:400:kworker.0 00010000:00010000:3.0:1784403475.171363:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403475.171533:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260891264:0@lo:400:kworker.0 00000100:00100000:0.0:1784403475.171607:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403475.171660:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260891264 00000100:00100000:0.0:1784403475.171665:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260891264 00000100:00100000:0.0:1784403475.171703:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784403475.171713:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260891264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403475.171747:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260891264:12345-0@lo:400:kworker.0 Request processed in 38us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403475.171754:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784403475.171781:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a73605880 x1871082260891264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403475.171791:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260891264:0@lo:400:kworker.0 00000100:00080000:0.0:1784403475.171807:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403475.173289:0:15768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260891008 00000100:00100000:2.0:1784403475.173304:0:15768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260891008 00000100:00100000:2.0:1784403475.173348:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784403475.173357:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3564:x1871082260891008:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784403475.173382:0:15768:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784403475.211122:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3564:x1871082260891008:12345-0@lo:8:kworker.0 Request processed in 37327us (39791us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784403475.211138:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1784403475.211196:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784403475.211201:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784403475.211206:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260891008:0@lo:8:kworker.0 00000001:00100000:3.0:1784403475.308945:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784403475.313954:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1784403476.192314:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784403476.596945:0:16101:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784403476.596950:0:16101:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1784403476.597163:0:16101:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c8a506c2000 00000020:01000004:3.0:1784403476.597192:0:16101:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784403476.597206:0:16101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1784403476.597383:0:16101:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c8a527a4d40) 00000020:00000080:3.0:1784403476.597404:0:16101:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00000040:00080000:0.0:1784403476.641246:0:14830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00100000:10000000:2.0:1784403476.650755:0:16101:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784403476.651104:0:16101:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784403476.653240:0:16101:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784403476.653493:0:16101:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1784403476.653985:0:16101:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784403476.654561:0:16101:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 421: rc = 0 00100000:10000000:2.0:1784403476.656829:0:16101:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 421: rc = 0 00100000:10000000:2.0:1784403476.657482:0:16101:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 421: rc = 0 00100000:10000000:2.0:1784403476.658901:0:16101:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 546: rc = 0 00100000:10000000:2.0:1784403476.659320:0:16101:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 546: rc = 0 00100000:10000000:2.0:1784403476.659576:0:16101:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 546: rc = 0 00100000:10000000:2.0:1784403476.660429:0:16101:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 546: rc = 0 00100000:10000000:2.0:1784403476.660780:0:16101:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 546: rc = 0 00100000:10000000:2.0:1784403476.661445:0:16101:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 546: rc = 0 00000020:00000080:2.0:1784403476.663589:0:16101:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784403476.664789:0:16101:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784403476.664809:0:16101:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6828175665afb94a 00000020:01000004:2.0:1784403476.664819:0:16101:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784403476.664849:0:16101:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784403476.664853:0:16101:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784403476.664946:0:16101:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784403476.664984:0:16101:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784403476.664988:0:16101:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1784403476.686403:0:16101:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784403476.686460:0:16101:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.128@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1784403476.686465:0:16101:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784403476.686467:0:16101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784403476.686469:0:16101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403476.686470:0:16101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403476.686472:0:16101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403476.686473:0:16101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403476.686475:0:16101:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403476.686477:0:16101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403476.686479:0:16101:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784403476.686483:0:16101:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1784403476.686485:0:16101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784403476.686487:0:16101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784403476.686488:0:16101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403476.686490:0:16101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403476.686491:0:16101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403476.686492:0:16101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403476.686493:0:16101:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403476.686495:0:16101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403476.686496:0:16101:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784403476.686603:0:16101:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784403476.686628:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260891392:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784403476.686713:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403476.687043:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a6106c900 going to sleep for 11 seconds 00000100:00100000:1.0:1784403476.687195:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260891392 00000100:00100000:1.0:1784403476.687204:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260891392 00000100:00100000:1.0:1784403476.687260:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784403476.687270:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:16101:x1871082260891392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784403476.687314:0:14791:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784403476.687318:0:14791:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1784403476.687322:0:14791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784403476.713477:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:16101:x1871082260891392:12345-0@lo:253:mount.lustre.0 Request processed in 26198us (26752us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403476.713494:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784403476.713541:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260891392:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784403476.713560:0:16101:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784403476.713563:0:16101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784403476.713565:0:16101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784403476.713566:0:16101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403476.713567:0:16101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403476.713569:0:16101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403476.713570:0:16101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403476.713571:0:16101:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403476.713573:0:16101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403476.713574:0:16101:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784403476.713609:0:16101:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c8a506c2000 from lustre-OST0001 10000000:01000000:2.0:1784403476.713642:0:16101:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1784403476.713645:0:16101:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784403476.713654:0:16101:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c8a72e419c0 local copy 00010000:00010000:2.0:1784403476.713665:0:16101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb6fe expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403476.713951:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260891520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784403476.713997:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403476.714034:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a6106c840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403476.714382:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260891520 00000100:00100000:3.0:1784403476.714391:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260891520 00000100:00100000:3.0:1784403476.714446:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784403476.714456:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+16:16101:x1871082260891520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784403476.714756:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+16:16101:x1871082260891520:12345-0@lo:501:mount.lustre.0 Request processed in 300us (757us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784403476.714764:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784403476.714919:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260891520:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784403476.714939:0:16101:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784403476.715280:0:16101:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784403476.715292:0:16101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb6fe expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403476.715303:0:16101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2000/0x6828175665afb6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb6fe expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403476.715351:0:16101:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c8a506c2000 10000000:01000000:2.0:1784403476.715358:0:16101:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784403476.715365:0:16101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784403476.715368:0:16101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784403476.720394:0:16101:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784403476.720405:0:16101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784403476.720464:0:16101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403476.720477:0:16101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403476.720511:0:16101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403476.720542:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260891648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784403476.720619:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403476.720746:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1784403476.721570:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260891648 00000100:00100000:1.0:1784403476.721580:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260891648 00000100:00100000:1.0:1784403476.721650:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784403476.721673:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+16:16101:x1871082260891648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784403476.721702:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403476.721720:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a734a0000/0x6828175665afb958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb951 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403476.721750:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a734a0000/0x6828175665afb958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb951 expref: 17 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403476.721762:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a734a0000/0x6828175665afb958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb951 expref: 17 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403476.721772:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0000, rc 0) 00000100:00100000:1.0:1784403476.722679:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+17:16101:x1871082260891648:12345-0@lo:101:mount.lustre.0 Request processed in 1005us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403476.722697:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784403476.723901:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260891648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784403476.723934:0:16101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb958 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403476.723948:0:16101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb958 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784403476.725342:0:16101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784403476.727104:0:16101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784403476.727712:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784403476.727763:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784403476.728353:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784403476.728495:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784403476.728535:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784403476.728572:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784403476.728642:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784403476.728651:0:16101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784403476.728903:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260891776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784403476.728974:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403476.729140:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403476.729408:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260891776 00000100:00100000:1.0:1784403476.729417:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260891776 00000100:00100000:1.0:1784403476.729481:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784403476.729492:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+17:16101:x1871082260891776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784403476.731769:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+17:16101:x1871082260891776:12345-0@lo:501:mount.lustre.0 Request processed in 2268us (2783us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403476.731786:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784403476.732318:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260891776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784403476.732452:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260891904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784403476.732525:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403476.732567:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403476.732617:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260891904 00000100:00100000:1.0:1784403476.732625:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260891904 00000100:00100000:1.0:1784403476.732679:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784403476.732688:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+17:16101:x1871082260891904:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784403476.733128:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+17:16101:x1871082260891904:12345-0@lo:503:mount.lustre.0 Request processed in 439us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403476.733143:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784403476.733261:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260891904:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784403476.734969:0:16101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784403476.735147:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784403476.735300:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403476.735350:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403476.735488:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260892032 00000100:00100000:1.0:1784403476.735495:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260892032 00000100:00100000:1.0:1784403476.735554:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784403476.735565:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+17:16101:x1871082260892032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784403476.735995:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+17:16101:x1871082260892032:12345-0@lo:502:mount.lustre.0 Request processed in 430us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403476.736003:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784403476.736258:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784403476.736575:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1784403476.736641:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1784403476.736673:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1784403476.736773:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1784403476.736811:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1784403476.736846:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1784403476.737483:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1784403476.737532:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1784403476.737581:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1784403476.737627:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784403476.738142:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403476.738306:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a73a06600 going to sleep for 11 seconds 00000100:00100000:2.0:1784403476.738369:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260892160 00000100:00100000:2.0:1784403476.738442:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260892160 00000100:00100000:2.0:1784403476.739558:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784403476.739574:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+17:16101:x1871082260892160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784403476.739927:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+17:16101:x1871082260892160:12345-0@lo:502:mount.lustre.0 Request processed in 358us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403476.739935:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784403476.741845:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784403476.743463:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1784403476.743556:0:16101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1784403476.745104:0:16103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784403476.745115:0:16103:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1784403476.745123:0:16103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.745125:0:16103:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1784403476.745133:0:16103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784403476.745150:0:16103:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c8a72e44d40) 00000020:00000080:1.0:1784403476.745247:0:16103:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784403476.745255:0:16103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784403476.745329:0:16103:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a506c2000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1784403476.745336:0:16103:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784403476.745343:0:16103:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6828175665afb966 00010000:00010000:1.0:1784403476.751135:0:16103:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1784403476.752151:0:16103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1784403476.756585:0:16103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1784403476.758667:0:16103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1784403476.758691:0:16103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403476.758699:0:16103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.758701:0:16103:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1784403476.758706:0:16103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403476.758710:0:16103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.758712:0:16103:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784403476.758715:0:16103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784403476.758717:0:16103:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784403476.758720:0:16103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403476.758722:0:16103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.758724:0:16103:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784403476.758726:0:16103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403476.758728:0:16103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.758730:0:16103:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784403476.758733:0:16103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1784403476.758796:0:16103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403476.758800:0:16103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.758801:0:16103:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784403476.758805:0:16103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1784403476.759108:0:16101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1784403476.759144:0:16101:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784403476.759173:0:16101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb958 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403476.759185:0:16101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7a00/0x6828175665afb951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb958 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403476.759192:0:16101:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a506c2000 from 1 10000000:01000000:2.0:1784403476.759202:0:16101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784403476.759240:0:16101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403476.759249:0:16101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403476.759259:0:16101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403476.759288:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784403476.759363:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403476.759414:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a6106c540 going to sleep for 11 seconds 00000100:00100000:0.0:1784403476.759552:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260892288 00000100:00100000:0.0:1784403476.759560:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260892288 00000100:00100000:0.0:1784403476.759614:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784403476.759624:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+17:16101:x1871082260892288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784403476.759637:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403476.759651:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce5600/0x6828175665afb974 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb96d expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.759678:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce5600/0x6828175665afb974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb96d expref: 18 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.759689:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce5600/0x6828175665afb974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb96d expref: 18 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.759700:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5600, rc 0) 00000100:00100000:0.0:1784403476.759744:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260892288:12345-0@lo:101:mount.lustre.0 Request processed in 122us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403476.759751:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784403476.760106:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784403476.760123:0:16101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403476.760133:0:16101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784403476.760678:0:16101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1784403476.761142:0:16101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784403476.761390:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1784403476.761438:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1784403476.761502:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1784403476.761509:0:16101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1784403476.761576:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784403476.761633:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403476.761671:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a6106c540 going to sleep for 11 seconds 00000100:00100000:0.0:1784403476.761857:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260892416 00000100:00100000:0.0:1784403476.761887:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260892416 00000100:00100000:0.0:1784403476.761929:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784403476.761938:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260892416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784403476.762193:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260892416:12345-0@lo:501:mount.lustre.0 Request processed in 255us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403476.762213:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784403476.762749:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784403476.762799:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784403476.762846:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403476.763016:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a6106c540 going to sleep for 11 seconds 00000100:00100000:1.0:1784403476.763569:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260892544 00000100:00100000:1.0:1784403476.763577:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260892544 00000100:00100000:1.0:1784403476.763615:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784403476.763623:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260892544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784403476.765279:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260892544:12345-0@lo:503:mount.lustre.0 Request processed in 1649us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403476.765292:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784403476.777644:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892544:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784403476.778720:0:16101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784403476.779260:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943274700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784403476.779356:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403476.779405:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a411ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1784403476.779425:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260892672 00000100:00100000:2.0:1784403476.779434:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260892672 00000100:00100000:2.0:1784403476.779499:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784403476.779510:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260892672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784403476.779773:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260892672:12345-0@lo:502:mount.lustre.0 Request processed in 264us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403476.779782:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784403476.781143:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943274700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784403476.781471:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1784403476.781545:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1784403476.781595:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1784403476.781632:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1784403476.781662:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1784403476.781723:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1784403476.781763:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1784403476.781800:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1784403476.781842:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943274700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784403476.781942:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403476.781985:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a411ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1784403476.783129:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260892800 00000100:00100000:1.0:1784403476.783138:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260892800 00000100:00100000:1.0:1784403476.783222:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784403476.783232:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260892800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784403476.783586:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260892800:12345-0@lo:502:mount.lustre.0 Request processed in 355us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403476.783595:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784403476.783716:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943274700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784403476.783858:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784403476.783894:0:16101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1784403476.786311:0:16107:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403476.786325:0:16107:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.786328:0:16107:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784403476.786336:0:16107:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a506c2000 00000020:00000080:1.0:1784403476.786338:0:16107:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784403476.786345:0:16107:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403476.786348:0:16107:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.786349:0:16107:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784403476.786352:0:16107:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403476.786354:0:16107:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.786356:0:16107:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784403476.786359:0:16107:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c8a506c2000 00000020:00000080:1.0:1784403476.786361:0:16107:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784403476.786421:0:16107:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403476.786425:0:16107:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.786426:0:16107:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1784403476.786429:0:16107:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784403476.786431:0:16107:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.786432:0:16107:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784403476.786436:0:16107:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c8a506c2000 00000020:00000080:1.0:1784403476.786438:0:16107:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784403476.786469:0:16107:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784403476.786473:0:16107:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784403476.786475:0:16107:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1784403476.786546:0:16107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1784403476.787719:0:16101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1784403476.787761:0:16101:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784403476.787781:0:16101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403476.787793:0:16101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403476.787840:0:16101:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784403476.787843:0:16101:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c8a506c2000 10000000:01000000:3.0:1784403476.787846:0:16101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c8a506c2000 10000000:01000000:3.0:1784403476.787851:0:16101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784403476.787857:0:16101:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c8a506c2000 from 1 10000000:01000000:3.0:1784403476.787860:0:16101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784403476.787914:0:16101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6800/0x6828175665afb97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403476.787924:0:16101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6800/0x6828175665afb97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403476.787935:0:16101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6800/0x6828175665afb97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403476.787972:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784403476.788074:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403476.788117:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745a540 going to sleep for 11 seconds 00000100:00100000:2.0:1784403476.788595:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260892928 00000100:00100000:2.0:1784403476.788603:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260892928 00000100:00100000:2.0:1784403476.788658:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784403476.788668:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260892928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784403476.788684:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403476.788699:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b3c00/0x6828175665afb982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb97b expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403476.788724:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b3c00/0x6828175665afb982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb97b expref: 19 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403476.788734:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b3c00/0x6828175665afb982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb97b expref: 19 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403476.788742:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3c00, rc 0) 00000100:00100000:2.0:1784403476.788802:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+19:16101:x1871082260892928:12345-0@lo:101:mount.lustre.0 Request processed in 127us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403476.788818:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784403476.789040:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260892928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784403476.789067:0:16101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6800/0x6828175665afb97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb982 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403476.789076:0:16101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6800/0x6828175665afb97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb982 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784403476.791613:0:16101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1784403476.792077:0:16101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784403476.792339:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784403476.792386:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1784403476.792421:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1784403476.792469:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1784403476.792506:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1784403476.792556:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1784403476.792592:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1784403476.792627:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1784403476.792676:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1784403476.792713:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1784403476.792748:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1784403476.792799:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1784403476.792836:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1784403476.792921:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1784403476.792978:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1784403476.793014:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1784403476.793047:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1784403476.793125:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1784403476.793166:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1784403476.793201:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1784403476.793251:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1784403476.793286:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1784403476.793323:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1784403476.793370:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1784403476.793408:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1784403476.793445:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1784403476.793495:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1784403476.793533:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1784403476.793568:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1784403476.793639:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1784403476.793679:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1784403476.793713:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1784403476.793744:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1784403476.793785:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1784403476.793819:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1784403476.793893:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1784403476.793934:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1784403476.794021:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1784403476.794029:0:16101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1784403476.800760:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260893056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784403476.800836:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403476.800894:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7745a540 going to sleep for 11 seconds 00000100:00100000:0.0:1784403476.801948:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260893056 00000100:00100000:0.0:1784403476.801958:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260893056 00000100:00100000:0.0:1784403476.802009:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784403476.802019:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77613c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+19:16101:x1871082260893056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784403476.802345:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77613c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+19:16101:x1871082260893056:12345-0@lo:501:mount.lustre.0 Request processed in 326us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403476.802354:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784403476.802412:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260893056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784403476.802468:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943277800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260893184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784403476.802642:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403476.802677:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586cdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784403476.803239:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260893184 00000100:00100000:2.0:1784403476.803247:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260893184 00000100:00100000:2.0:1784403476.803291:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784403476.803299:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77610850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+19:16101:x1871082260893184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784403476.804316:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77610850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+19:16101:x1871082260893184:12345-0@lo:503:mount.lustre.0 Request processed in 1013us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403476.804325:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784403476.804660:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943277800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260893184:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784403476.808707:0:16101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784403476.808831:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943277800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260893312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784403476.808929:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403476.808981:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586cdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403476.809175:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260893312 00000100:00100000:1.0:1784403476.809184:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260893312 00000100:00100000:1.0:1784403476.809228:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784403476.809238:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+19:16101:x1871082260893312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784403476.809583:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+19:16101:x1871082260893312:12345-0@lo:502:mount.lustre.0 Request processed in 345us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403476.809592:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784403476.809674:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943277800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260893312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784403476.809974:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1784403476.810035:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1784403476.810088:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1784403476.810153:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1784403476.810205:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1784403476.810263:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1784403476.810309:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1784403476.810575:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1784403476.810644:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1784403476.810686:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1784403476.810735:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1784403476.810814:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1784403476.810852:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1784403476.811665:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1784403476.811729:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1784403476.811782:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1784403476.811937:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1784403476.811994:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1784403476.812031:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1784403476.812081:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1784403476.812130:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1784403476.812165:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1784403476.812199:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1784403476.812247:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1784403476.812282:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1784403476.812313:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1784403476.812371:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1784403476.812405:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1784403476.812438:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1784403476.813934:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1784403476.814024:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1784403476.814093:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1784403476.814129:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1784403476.814191:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1784403476.814231:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1784403476.814282:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1784403476.814322:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1784403476.814357:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1784403476.814407:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1784403476.814441:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1784403476.816620:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260893440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784403476.816773:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403476.816820:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68780 going to sleep for 11 seconds 00000100:00100000:3.0:1784403476.817385:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260893440 00000100:00100000:3.0:1784403476.817394:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260893440 00000100:00100000:3.0:1784403476.817459:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784403476.817470:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+19:16101:x1871082260893440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784403476.818388:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+19:16101:x1871082260893440:12345-0@lo:502:mount.lustre.0 Request processed in 917us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403476.818404:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784403476.818613:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260893440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784403476.818743:0:16101:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1784403476.818759:0:16101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1784403476.820262:0:16112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784403476.820278:0:16112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c8a527a19c0) 00000020:00000080:3.0:1784403476.820300:0:16112:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1784403476.820936:0:16112:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c8a506c2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784403476.820941:0:16112:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c8a506c2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784403476.820944:0:16112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c8a506c2000 3 00010000:00080000:3.0:1784403476.820975:0:16112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c8a8156a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.128@tcp at head 00010000:00010000:2.0:1784403476.824928:0:16112:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1784403476.825074:0:16112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784403476.825126:0:16112:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784403476.825140:0:16112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6828175665afb990 00000100:00080000:2.0:1784403476.825152:0:16112:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784403476.825158:0:16112:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c8a8156a800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1784403476.825198:0:16112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a7744b480 x1871082260893568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784403476.825229:0:16112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784403476.825278:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784403476.825282:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784403476.825285:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784403476.825289:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1784403476.825293:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784403476.825296:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c8a52cc7800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1784403476.825307:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a77449500 x1871082260893824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784403476.825371:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260893696:0@lo:400:kworker.0 00000100:00100000:2.0:1784403476.825436:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403476.825600:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3564:1871082260893568:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784403476.825638:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403476.825670:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260893824:0@lo:8:kworker.0 00000100:00100000:0.0:1784403476.825695:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403476.825741:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260893568 00000100:00100000:0.0:1784403476.825748:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260893568 00000100:00100000:0.0:1784403476.825782:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784403476.825789:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3564:x1871082260893568:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784403476.825828:0:14796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:0.0:1784403476.825863:0:14796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6828175665afb997 00000004:00100000:0.0:1784403476.825894:0:14796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784403476.825925:0:14796:0:(import.c:65:import_set_state_nolock()) ffff8c8a7c667000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784403476.825975:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3564:x1871082260893568:12345-0@lo:38:llog_process_th.0 Request processed in 184us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403476.825988:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784403476.826033:0:3564:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a7744b480 x1871082260893568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784403486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403476.826044:0:3564:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784403476.826061:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1784403476.826069:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784403476.826074:0:3564:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784403476.826076:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a8156a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784403476.826083:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3564:1871082260893568:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784403476.826223:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260893952:0@lo:400:kworker.0 00000100:00100000:2.0:1784403476.826251:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403476.826279:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403476.826285:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260894080:0@lo:400:kworker.0 00000100:00100000:2.0:1784403476.826306:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403476.826338:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260893696 00000100:00100000:2.0:1784403476.826342:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260893696 00000100:00100000:2.0:1784403476.826374:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260893824 00000100:00100000:2.0:1784403476.826377:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260893824 00000100:00100000:2.0:1784403476.826393:0:15430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403476.826400:0:15430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7744a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260893696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403476.826441:0:15430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7744a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260893696:12345-0@lo:400:kworker.0 Request processed in 42us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403476.826448:0:15430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403476.826461:0:15430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784403476.826464:0:15430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3564:x1871082260893824:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1784403476.826576:0:15430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3564:x1871082260893824:12345-0@lo:8:kworker.0 Request processed in 109us (879us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784403476.826584:0:15430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784403476.826615:0:3566:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1784403476.826626:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260893696:0@lo:400:kworker.0 00000100:00100000:2.0:1784403476.826644:0:3564:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784403476.826649:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784403476.826659:0:3564:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784403476.826662:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260893824:0@lo:8:kworker.0 00000100:00100000:2.0:1784403476.826681:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260893952 00000100:00100000:2.0:1784403476.826684:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260893952 00000100:00100000:2.0:1784403476.826707:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260894080 00000100:00100000:2.0:1784403476.826710:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260894080 00000100:00100000:2.0:1784403476.826722:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784403476.826728:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7744ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260893952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403476.826761:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7744ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260893952:12345-0@lo:400:kworker.0 Request processed in 32us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403476.826767:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784403476.826778:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784403476.826783:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260894080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403476.827205:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260894080:12345-0@lo:400:kworker.0 Request processed in 421us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403476.827212:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784403476.827244:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a77449180 x1871082260894080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403476.827254:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260894080:0@lo:400:kworker.0 00010000:00080000:2.0:1784403476.827266:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c8a77449f80 x1871082260893952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784403476.827275:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260893952:0@lo:400:kworker.0 00000040:00080000:2.0:1784403476.827761:0:16112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1784403476.828699:0:16101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1784403476.828731:0:16101:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784403476.828756:0:16101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6800/0x6828175665afb97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb982 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403476.828768:0:16101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6800/0x6828175665afb97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb982 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784403476.828815:0:16101:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784403476.828817:0:16101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784403476.828819:0:16101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403476.828820:0:16101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784403476.828821:0:16101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403476.828822:0:16101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403476.828823:0:16101:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784403476.828829:0:16101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403476.828830:0:16101:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784403476.828834:0:16101:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1784403476.828836:0:16101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784403476.828837:0:16101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784403476.829033:0:16101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784403476.829035:0:16101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784403476.829036:0:16101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784403476.829038:0:16101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784403476.829038:0:16101:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784403476.829039:0:16101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784403476.829040:0:16101:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784403476.829075:0:16101:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784403476.829096:0:16101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260894208:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784403476.829219:0:16101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403476.829260:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260894208 00000100:00100000:1.0:1784403476.829266:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260894208 00000100:00100000:1.0:1784403476.829306:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784403476.829315:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+19:16101:x1871082260894208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784403476.829342:0:14792:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784403476.829357:0:14792:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1784403476.832549:0:16101:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68c00 going to sleep for 11 seconds 20000000:01000000:1.0:1784403476.851718:0:14792:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784403476.851746:0:14792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1784403476.851798:0:14812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784403476.851804:0:14812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784403476.851827:0:14812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.851846:0:14812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a734a0400/0x6828175665afb878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb871 expref: 19 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.851854:0:14812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.852024:0:14812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a734a0400/0x6828175665afb878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afb871 expref: 19 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.852040:0:14812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a734a0400/0x6828175665afb878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afb871 expref: 19 pid: 14789 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403476.852066:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943275c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14812:1871082260894336:0@lo:104: 00000100:00100000:0.0:1784403476.852136:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403476.852231:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586cd840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403476.852384:0:14780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260894336 00000100:00100000:3.0:1784403476.852391:0:14780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260894336 00000100:00100000:3.0:1784403476.852562:0:14780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784403476.852575:0:14780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943274e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+3:14812:x1871082260894336:12345-0@lo:104: 00010000:00010000:3.0:1784403476.852590:0:14780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403476.852690:0:14780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784403476.852697:0:14780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943274e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+3:14812:x1871082260894336:12345-0@lo:104: Request processed in 125us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403476.852704:0:14780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1784403476.852715:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784403476.852721:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403476.852764:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943275c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14812:1871082260894336:0@lo:104: 00010000:00010000:2.0:1784403476.852784:0:14812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.852819:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2a00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:0.0:1784403476.852823:0:14786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.852832:0:14786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784403476.852840:0:14786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784403476.852855:0:14786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784403476.853366:0:14786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853373:0:14786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784403476.853405:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853413:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2a00/0x6828175665afb871 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb878 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853429:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403476.853431:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403476.853433:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403476.853442:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784403476.853455:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:001064a9-3cb5-489b-ba0a-bb457082004b:3566:1871082260894464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784403476.853515:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403476.853557:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260894464 00000100:00100000:0.0:1784403476.853562:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260894464 00010000:00010000:0.0:1784403476.853584:0:14784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a734a0400/0x6828175665afb878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb871 expref: 20 pid: 14789 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403476.853603:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784403476.853609:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943274000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:001064a9-3cb5-489b-ba0a-bb457082004b+20:3566:x1871082260894464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784403476.853618:0:14784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403476.853621:0:14784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a734a0400/0x6828175665afb878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb871 expref: 20 pid: 14789 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853630:0:14784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a734a0400/0x6828175665afb878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afb871 expref: 20 pid: 14789 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853640:0:14784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a734a0400/0x6828175665afb878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afb871 expref: 20 pid: 14789 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853650:0:14784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853656:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784403476.853666:0:14784:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001885041s 00010000:00010000:0.0:1784403476.853669:0:14784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853674:0:14784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853687:0:14784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853691:0:14784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853694:0:14784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403476.853696:0:14784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853701:0:14784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853709:0:14784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853716:0:14784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403476.853737:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943274000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:001064a9-3cb5-489b-ba0a-bb457082004b+19:3566:x1871082260894464:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403476.853742:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784403476.853764:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:001064a9-3cb5-489b-ba0a-bb457082004b:3566:1871082260894464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784403476.853777:0:14812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853782:0:14812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403476.853786:0:14812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce4c00/0x6828175665afb99e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403476.859066:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+18:16101:x1871082260894208:12345-0@lo:253:mount.lustre.0 Request processed in 29728us (29823us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403476.859082:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784403476.859324:0:16101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:001064a9-3cb5-489b-ba0a-bb457082004b:16101:1871082260894208:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784403476.859341:0:16101:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784403476.859344:0:16101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784403476.859346:0:16101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784403476.859347:0:16101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784403476.859348:0:16101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784403476.859349:0:16101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784403476.859350:0:16101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784403476.859352:0:16101:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784403476.859354:0:16101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784403476.859355:0:16101:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784403476.859371:0:16101:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784403476.868585:0:16101:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784403476.868737:0:16101:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784403476.869252:0:16101:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784403476.869416:0:16101:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784403476.869626:0:16101:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784403476.869809:0:16101:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1784403476.870739:0:16101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1784403476.951333:0:16101:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1784403476.951344:0:16101:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1784403476.951389:0:16101:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784403476.951464:0:16101:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784403476.951478:0:16101:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1784403476.951506:0:16101:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1784403477.215979:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784403477.918941:0:14794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784403477.918950:0:14794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c8a7303e800 from 8 10000000:01000000:1.0:1784403477.918955:0:14794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784403477.919006:0:14794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1200/0x6828175665afb9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403477.919025:0:14794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1200/0x6828175665afb9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403477.919052:0:14794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1200/0x6828175665afb9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403477.919084:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260894592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784403477.919174:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403477.919229:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a7fe68840 going to sleep for 11 seconds 00000100:00100000:3.0:1784403477.921928:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260894592 00000100:00100000:3.0:1784403477.921943:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260894592 00000100:00100000:3.0:1784403477.922005:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784403477.922015:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+18:14794:x1871082260894592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403477.922044:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403477.922064:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6000/0x6828175665afb9ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afb9a5 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403477.922093:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6000/0x6828175665afb9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afb9a5 expref: 19 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403477.922105:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6000/0x6828175665afb9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb9a5 expref: 19 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403477.922114:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6000, rc 0) 00000100:00100000:3.0:1784403477.922218:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+19:14794:x1871082260894592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403477.922225:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784403477.923320:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260894592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403477.923349:0:14794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1200/0x6828175665afb9a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb9ac expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403477.923362:0:14794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1200/0x6828175665afb9a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afb9ac expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403477.923454:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943275c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260894720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784403477.923515:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403477.923561:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a586cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403477.923783:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260894720 00000100:00100000:1.0:1784403477.923792:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260894720 00000100:00100000:1.0:1784403477.923847:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784403477.923857:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+19:14794:x1871082260894720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784403477.923917:0:14792:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784403477.923936:0:14792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784403477.923940:0:14792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1784403477.924058:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+19:14794:x1871082260894720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 202us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403477.924066:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784403477.926609:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943275c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260894720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784403477.926704:0:14794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784403477.926715:0:14794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1200/0x6828175665afb9a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb9ac expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403477.926726:0:14794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1200/0x6828175665afb9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afb9ac expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403478.243070:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403479.263118:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403480.287152:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260894848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784403480.287231:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403480.287316:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260894848 00000100:00100000:1.0:1784403480.287323:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260894848 00000100:00100000:1.0:1784403480.287384:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784403480.287393:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260894848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784403480.287443:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403480.287489:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260894848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403480.287496:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1784403480.287534:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403480.287575:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260894848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784403480.291496:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784403481.311593:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784403482.335168:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784403482.335174:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784403482.335178:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784403482.335192:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c8a52cc7800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1784403482.335218:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c8a77449500 x1871082260895232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784403482.335318:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260894976:0@lo:400:kworker.0 00000100:00100000:2.0:1784403482.335392:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403482.335448:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260895616:0@lo:400:kworker.0 00000100:00100000:2.0:1784403482.335479:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403482.335506:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784403482.335512:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260895104:0@lo:400:kworker.0 00000100:00100000:2.0:1784403482.335538:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403482.335567:0:3564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260895232:0@lo:8:kworker.0 00000100:00100000:2.0:1784403482.335611:0:3564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403482.336068:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260895360:0@lo:400:kworker.0 00000100:00100000:2.0:1784403482.336095:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403482.336114:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784403482.336119:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7744b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260895488:0@lo:400:kworker.0 00000100:00100000:2.0:1784403482.336140:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403482.336179:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260894976 00000100:00100000:2.0:1784403482.336186:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260894976 00000100:00100000:2.0:1784403482.336228:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784403482.336237:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+19:3567:x1871082260894976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403482.336285:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+19:3567:x1871082260894976:12345-0@lo:400:kworker.0 Request processed in 48us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403482.336292:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784403482.336324:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260895616 00000100:00100000:2.0:1784403482.336328:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260895616 00000100:00100000:2.0:1784403482.336801:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260895360 00000100:00100000:2.0:1784403482.336807:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260895360 00000100:00100000:2.0:1784403482.336823:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260895488 00000100:00100000:2.0:1784403482.336825:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260895488 00000100:00100000:2.0:1784403482.336847:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784403482.336853:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260895616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403482.337347:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260895616:12345-0@lo:400:kworker.0 Request processed in 491us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403482.337356:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1784403482.337979:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784403482.338719:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403482.339579:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784403482.339712:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260895360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403482.340125:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260895360:12345-0@lo:400:kworker.0 Request processed in 532us (4026us total) trans 0 rc 0/0 00010000:00080000:1.0:1784403482.340211:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77448a80 x1871082260895360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784403482.340228:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260895360:0@lo:400:kworker.0 00000100:00100000:0.0:1784403482.341015:0:15768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260895104 00000100:00100000:0.0:1784403482.341026:0:15768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260895104 00000100:00100000:0.0:1784403482.341096:0:15768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260895232 00000100:00100000:0.0:1784403482.341100:0:15768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260895232 00000100:00100000:0.0:1784403482.341122:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403482.341138:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7744b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260895104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403482.341199:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7744b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260895104:12345-0@lo:400:kworker.0 Request processed in 68us (5660us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403482.341206:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403482.341224:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784403482.341228:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3564:x1871082260895232:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784403482.341253:0:15768:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1784403482.341282:0:15768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6828175665afb9b3 00002000:00100000:0.0:1784403482.341295:0:15768:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c8a7c666000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784403482.341308:0:15768:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784403482.341311:0:15768:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1784403482.341731:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1784403482.341976:0:15768:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784403482.342005:0:15768:0:(import.c:65:import_set_state_nolock()) ffff8c8a7c663800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784403482.342139:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784403482.342154:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260895488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403482.342204:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3565:x1871082260895488:12345-0@lo:400:kworker.0 Request processed in 55us (6063us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403482.342211:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1784403482.342291:0:3565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7744b480 x1871082260895488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403482.342306:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3565:1871082260895488:0@lo:400:kworker.0 00000100:00100000:3.0:1784403482.342548:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260895104:0@lo:400:kworker.0 00000100:00100000:3.0:1784403482.342561:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260894976:0@lo:400:kworker.0 00010000:00080000:3.0:1784403482.342579:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7744b100 x1871082260895616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784403498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784403482.342589:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7744b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260895616:0@lo:400:kworker.0 00000100:00100000:0.0:1784403482.342709:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3564:x1871082260895232:12345-0@lo:8:kworker.0 Request processed in 1477us (7095us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403482.342717:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784403482.346113:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1784403482.346700:0:3564:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a77449500 x1871082260895232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784403507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784403482.346722:0:3564:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784403482.346731:0:3564:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784403482.346737:0:3564:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784403482.346741:0:3564:0:(import.c:65:import_set_state_nolock()) ffff8c8a52cc7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784403482.346767:0:3564:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784403482.346774:0:3564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3564:1871082260895232:0@lo:8:kworker.0 00000004:00080000:1.0:1784403482.346805:0:14820:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784403482.347708:0:14820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 487915835367ns, next at 0ns, rc = 0 00000004:00080000:2.0:1784403482.347841:0:14821:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1784403482.347900:0:14821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af41c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14821:1871082260895872:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784403482.347980:0:14821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403482.348007:0:14821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a46a51180 going to sleep for 11 seconds 00000100:00100000:1.0:1784403482.348017:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784403482.348032:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260895744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403482.348064:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403482.348108:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260895872 00000100:00100000:1.0:1784403482.348116:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260895872 00000100:00100000:1.0:1784403482.348182:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784403482.348193:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14821:x1871082260895872:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784403482.353304:0:15429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1784403482.353318:0:15429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1784403482.353325:0:15429:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:2.0:1784403482.355993:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260895744 00000100:00100000:2.0:1784403482.356009:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260895744 00000100:00100000:2.0:1784403482.356132:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784403482.356143:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260895744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403482.356185:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403482.356268:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3567:x1871082260895744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (8203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403482.356276:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1784403482.356298:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784403482.361804:0:3567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c8a7af41880 x1871082260895744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784403498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784403482.361836:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260895744:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1784403482.364446:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.364460:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.364480:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.364485:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.364493:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.364510:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.364522:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.364531:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.364552:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.364565:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.364570:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.364586:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.364591:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.364602:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.366570:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.366588:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.366625:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.366628:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.366631:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.368610:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.369007:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.369027:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.369032:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.369040:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.369055:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.369077:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.372291:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.372336:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.372371:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.372377:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.372387:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.372392:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.372405:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.372427:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.372435:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.372458:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.372473:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.372475:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.377196:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.377210:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb9c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.377228:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.377233:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.377240:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb9c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.377255:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb9c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.377265:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb9c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.377271:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb9c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.377296:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403482.379111:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403482.379123:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb9c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.379137:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403482.379142:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb9c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.379165:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb9c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.379186:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb9c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.379193:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afb9c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.379213:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.379214:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.379216:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.381213:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.381227:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.381243:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.381248:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.381254:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.381276:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.381286:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.381294:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.381313:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.381327:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.381332:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.381339:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.381343:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.381352:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.381368:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.381376:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000babdbf33/0x6828175665afb9cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.381400:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.381401:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.381403:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.383840:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.383886:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073258813/0x6828175665afb9d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.383904:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.383909:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.383915:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073258813/0x6828175665afb9d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.383930:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073258813/0x6828175665afb9d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.383941:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073258813/0x6828175665afb9d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.383958:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073258813/0x6828175665afb9d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.383981:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.383998:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.384004:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073258813/0x6828175665afb9d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384031:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.384036:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073258813/0x6828175665afb9d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384046:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073258813/0x6828175665afb9d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384234:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073258813/0x6828175665afb9d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384244:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073258813/0x6828175665afb9d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384266:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.384269:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.384271:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.384786:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.384792:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afb9dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384803:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.384807:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.384812:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afb9dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384824:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afb9dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384840:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afb9dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384848:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afb9dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384885:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.384896:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.384902:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afb9dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384909:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0a00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.384912:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afb9dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384919:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afb9dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384930:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afb9dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384937:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afb9dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.384969:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.384976:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.384979:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.385902:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.385914:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afb9e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.385927:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.385931:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.385936:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afb9e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.385958:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afb9e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.385967:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afb9e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.385974:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afb9e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.385991:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.386001:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.386006:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afb9e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.386014:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.386017:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afb9e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.386039:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afb9e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.386059:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afb9e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.386067:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afb9e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.386087:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.386089:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.386091:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.386971:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.386980:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.386991:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.386995:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.387000:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.387011:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.387020:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.387034:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.387060:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403482.387119:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403482.387127:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.387137:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403482.387142:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.387152:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.387167:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.387188:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b3df282/0x6828175665afb9eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.387205:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.387207:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.387209:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.387581:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.387588:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afb9f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.387597:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.387600:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.387604:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afb9f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.387614:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afb9f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.387623:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afb9f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.387631:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afb9f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.387651:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784403482.388171:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.388180:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afb9f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388196:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.388199:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.388204:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afb9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388214:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afb9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388223:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afb9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388231:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afb9f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388246:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784403482.388258:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403482.388263:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afb9f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388270:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.388274:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afb9f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388281:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afb9f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388304:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afb9f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388312:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afb9f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388332:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.388335:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afb9f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388344:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1a00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.388347:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afb9f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388355:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afb9f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388365:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afb9f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388371:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afb9f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.388387:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.388390:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.388399:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.389931:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.390728:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.390738:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.390754:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.390759:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.390765:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.390779:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.390789:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.390798:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.390818:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784403482.391519:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403482.391523:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.391529:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.391533:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.391549:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1784403482.391553:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.391555:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403482.391560:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.391562:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.391583:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.391612:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.391617:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.391627:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.391666:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.391668:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.391676:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.391740:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.391748:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.391768:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.391780:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.391784:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.391791:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe000 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.391794:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.391802:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.391813:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.391820:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.391841:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.391842:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.391844:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.392713:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.392722:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.392734:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.392737:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.392742:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.392861:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.392915:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.392923:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.392964:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403482.393429:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403482.393438:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.393450:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403482.393460:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.393471:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.393492:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.393501:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784403482.393519:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403482.393521:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.393525:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.393527:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.393528:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.393551:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.393555:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.393560:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.393571:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.393580:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.393588:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.393606:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403482.393626:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403482.393632:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784403482.394693:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784403482.394699:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ffa00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.394702:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d94ea4/0x6828175665afba1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.394705:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.394726:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.394732:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.394738:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d94ea4/0x6828175665afba1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.394754:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.394757:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d94ea4/0x6828175665afba1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.394782:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.394788:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d94ea4/0x6828175665afba1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.394797:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d94ea4/0x6828175665afba1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.394817:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.394829:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.394833:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d94ea4/0x6828175665afba1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.394840:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.394843:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d94ea4/0x6828175665afba1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.394852:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d94ea4/0x6828175665afba1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.394884:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d94ea4/0x6828175665afba1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.394886:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.394902:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d94ea4/0x6828175665afba1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.394924:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.394930:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.394933:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.394934:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.394937:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.394938:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.395485:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.395493:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cfead43/0x6828175665afba23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.395502:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.395506:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.395510:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfead43/0x6828175665afba23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.395521:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cfead43/0x6828175665afba23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.395529:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cfead43/0x6828175665afba23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.395537:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cfead43/0x6828175665afba23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.395551:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403482.395859:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403482.395899:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cfead43/0x6828175665afba23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.395910:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403482.395914:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfead43/0x6828175665afba23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.395923:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfead43/0x6828175665afba23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.395937:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cfead43/0x6828175665afba23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.395967:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cfead43/0x6828175665afba23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.395985:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.395989:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.395991:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.396238:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.396246:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c41a3ab8/0x6828175665afba2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396255:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.396258:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.396264:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c41a3ab8/0x6828175665afba2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396281:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c41a3ab8/0x6828175665afba2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396291:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c41a3ab8/0x6828175665afba2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396299:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c41a3ab8/0x6828175665afba2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396317:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.396328:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.396333:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c41a3ab8/0x6828175665afba2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396340:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.396344:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c41a3ab8/0x6828175665afba2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396352:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c41a3ab8/0x6828175665afba2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396363:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c41a3ab8/0x6828175665afba2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396372:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c41a3ab8/0x6828175665afba2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396393:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.396394:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.396397:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.396885:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.396891:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a12d3dd4/0x6828175665afba31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396901:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.396904:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.396910:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a12d3dd4/0x6828175665afba31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396921:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a12d3dd4/0x6828175665afba31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396929:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a12d3dd4/0x6828175665afba31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396937:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a12d3dd4/0x6828175665afba31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.396973:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403482.396981:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403482.396988:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a12d3dd4/0x6828175665afba31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.396997:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ffc00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403482.397001:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a12d3dd4/0x6828175665afba31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.397010:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a12d3dd4/0x6828175665afba31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.397023:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a12d3dd4/0x6828175665afba31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.397031:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a12d3dd4/0x6828175665afba31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.397051:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.397053:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.397055:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.397492:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.397498:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca219c00/0x6828175665afba38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.397518:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.397522:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.397526:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca219c00/0x6828175665afba38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.397536:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca219c00/0x6828175665afba38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.397544:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca219c00/0x6828175665afba38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.397551:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca219c00/0x6828175665afba38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.397569:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403482.397580:0:14786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403482.397587:0:14786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca219c00/0x6828175665afba38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.397595:0:14786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403482.397599:0:14786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca219c00/0x6828175665afba38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.397607:0:14786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca219c00/0x6828175665afba38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.397618:0:14786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca219c00/0x6828175665afba38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.397626:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca219c00/0x6828175665afba38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.397648:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.397650:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.397652:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.398427:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.398435:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072ecf35a/0x6828175665afba3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.398447:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.398451:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.398456:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072ecf35a/0x6828175665afba3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.398467:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072ecf35a/0x6828175665afba3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.398490:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072ecf35a/0x6828175665afba3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.398498:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072ecf35a/0x6828175665afba3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.399090:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.399102:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.399108:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072ecf35a/0x6828175665afba3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.399207:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.399213:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072ecf35a/0x6828175665afba3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.399223:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072ecf35a/0x6828175665afba3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.399240:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072ecf35a/0x6828175665afba3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.399249:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072ecf35a/0x6828175665afba3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.399268:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.399277:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.399280:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.400819:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.400831:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.400845:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.400850:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.400973:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.400990:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401001:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401009:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401029:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.401042:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.401047:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401056:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414fe000 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.401061:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401095:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401113:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401184:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000431ce74f/0x6828175665afba46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401205:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.401207:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.401211:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.401823:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.401831:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401842:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.401846:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.401851:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401862:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401896:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.401915:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.402423:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784403482.403289:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.403299:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403313:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.403318:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.403325:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403337:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403346:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403354:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403369:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784403482.403379:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403482.403385:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403399:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ffa00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.403404:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403413:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403429:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403436:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015a51b10/0x6828175665afba4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403455:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.403459:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403466:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a414ff800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.403469:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403477:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403488:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403500:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d01e076d/0x6828175665afba54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.403518:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.403521:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.403523:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.403572:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784403482.404246:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1784403482.404368:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.404376:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.404388:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.404393:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.404398:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.404409:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.404419:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.404427:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.404447:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784403482.404509:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784403482.404517:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.404529:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403482.404534:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.404558:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.404575:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.404583:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6a92f6/0x6828175665afba5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403482.404604:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.404607:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.404609:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.404898:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.404904:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afba62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.404913:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.404916:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.404921:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afba62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.404930:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afba62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.404938:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afba62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.405330:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afba62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.405350:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.405362:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.405367:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afba62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.405375:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1a00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.405379:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afba62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.405400:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afba62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.405414:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afba62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.405423:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000969cd8ec/0x6828175665afba62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.405439:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.405441:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.405444:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.406459:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.406468:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afba69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.406482:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.406487:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.406493:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afba69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.406504:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afba69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.406514:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afba69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.406534:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afba69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.406779:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784403482.407578:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.407586:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afba70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407598:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.407602:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.407607:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afba70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407690:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afba70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407700:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afba70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407707:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afba70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407725:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784403482.407737:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403482.407742:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afba69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407757:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.407761:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afba69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407770:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afba69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407786:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afba69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407793:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000396e6a51/0x6828175665afba69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407810:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.407813:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afba70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407819:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1400 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.407822:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afba70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407828:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afba70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407836:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afba70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407851:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e98fbcc3/0x6828175665afba70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.407890:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.407893:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.407895:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403482.408177:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784403482.408459:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784403482.408465:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afba77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.408475:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1784403482.408479:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403482.408484:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afba77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.408495:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afba77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.408504:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afba77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.408511:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afba77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.408527:0:15429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403482.408536:0:14785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403482.408547:0:14785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afba77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.408554:0:14785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0a00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403482.408558:0:14785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afba77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.408565:0:14785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afba77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.408577:0:14785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afba77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.408584:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003035a996/0x6828175665afba77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403482.408601:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.408603:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403482.408605:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784403482.408936:0:15429:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1784403482.409043:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14821:x1871082260895872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 60848us (61058us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403482.409054:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784403482.410214:0:14821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af41c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14821:1871082260895872:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784403482.410235:0:14821:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1784403482.410285:0:14821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af41c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14821:1871082260896000:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784403482.410336:0:14821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403482.410394:0:14821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a58224b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784403482.411924:0:15431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260896000 00000100:00100000:3.0:1784403482.411936:0:15431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260896000 00000100:00100000:3.0:1784403482.412014:0:15431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784403482.412026:0:15431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14821:x1871082260896000:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1784403482.412080:0:15431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1784403482.423725:0:15431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14821:x1871082260896000:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11696us (13384us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784403482.423740:0:15431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784403482.423970:0:14821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af41c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14821:1871082260896000:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784403482.423987:0:14821:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:3.0:1784403482.425313:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:3.0:1784403483.313730:0:16458:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784403483.359804:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403484.384010:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403485.407024:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784403485.407051:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260896128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403485.407130:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403485.407172:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260896128 00000100:00100000:3.0:1784403485.407181:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260896128 00000100:00080000:2.0:1784403485.407221:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403485.407243:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784403485.407252:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260896128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784403485.407294:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00010000:1.0:1784403485.407299:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403485.407343:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260896128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403485.407349:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784403485.407645:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260896128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403485.683970:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403485.690260:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240975488 00000100:00100000:0.0:1784403485.690276:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240975488 00000100:00100000:0.0:1784403485.690340:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:0.0:1784403485.690349:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1871082240975488:12345-192.168.204.28@tcp:250:mount.lustre.0 00010000:00080000:0.0:1784403485.690377:0:14791:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c12d25a6-6fec-420f-abaf-beb60f397179@192.168.204.28@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:0.0:1784403485.690412:0:14791:0:(genops.c:1385:class_connect()) connect: client c12d25a6-6fec-420f-abaf-beb60f397179, cookie 0x6828175665afba7e 00000100:00080000:0.0:1784403485.690568:0:14791:0:(import.c:65:import_set_state_nolock()) ffff8c8a7c665000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784403485.690650:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+5:2357:x1871082240975488:12345-192.168.204.28@tcp:250:mount.lustre.0 Request processed in 300us (6692us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403485.690658:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:3.0:1784403485.698445:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403485.698581:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240975616 00000100:00100000:1.0:1784403485.698592:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240975616 00000100:00100000:1.0:1784403485.698655:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:1.0:1784403485.698675:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+5:13735:x1871082240975616:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784403485.698706:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403485.698738:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a734a0400/0x6828175665afba85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee8c expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403485.698769:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a734a0400/0x6828175665afba85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee8c expref: 6 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403485.698781:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a734a0400/0x6828175665afba85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee8c expref: 6 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403485.698791:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0400, rc 0) 00000100:00100000:1.0:1784403485.698859:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+6:13735:x1871082240975616:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 195us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403485.698905:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:1.0:1784403485.701940:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403485.702217:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240975744 00000100:00100000:0.0:1784403485.702229:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240975744 00000100:00100000:0.0:1784403485.702290:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:0.0:1784403485.702301:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a4551e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+6:13735:x1871082240975744:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784403485.703044:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a4551e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+6:13735:x1871082240975744:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 741us (1111us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784403485.703064:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:3.0:1784403485.707958:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403485.708146:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240975872 00000100:00100000:2.0:1784403485.708157:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240975872 00000100:00100000:2.0:1784403485.708220:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:2.0:1784403485.708231:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+6:13735:x1871082240975872:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784403485.708249:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403485.708271:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afba8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ee93 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403485.708308:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afba8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee93 expref: 7 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403485.708320:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7b5b3e00/0x6828175665afba8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ee93 expref: 7 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403485.708330:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3e00, rc 0) 00000100:00100000:2.0:1784403485.708395:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+7:13735:x1871082240975872:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 166us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403485.708401:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:3.0:1784403485.710817:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403485.710958:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240976000 00000100:00100000:0.0:1784403485.710967:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240976000 00000100:00100000:0.0:1784403485.711120:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:0.0:1784403485.711130:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+7:13735:x1871082240976000:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784403485.711446:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+8:13735:x1871082240976000:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 317us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403485.711454:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:3.0:1784403485.716638:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403485.720234:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240976128 00000100:00100000:2.0:1784403485.720251:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240976128 00000100:00100000:2.0:1784403485.720322:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:2.0:1784403485.720333:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+8:13735:x1871082240976128:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784403485.720615:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+8:13735:x1871082240976128:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 282us (3987us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403485.720629:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:3.0:1784403485.726604:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403485.726913:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240976256 00000100:00100000:2.0:1784403485.726933:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240976256 00000100:00100000:2.0:1784403485.727003:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:2.0:1784403485.727014:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+8:13753:x1871082240976256:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784403485.727341:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+8:13753:x1871082240976256:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 326us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403485.727350:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:3.0:1784403485.789607:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403485.793352:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240976384 00000100:00100000:1.0:1784403485.793370:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240976384 00000100:00100000:1.0:1784403485.793449:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:1.0:1784403485.793460:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+8:13753:x1871082240976384:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784403485.793775:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+8:13753:x1871082240976384:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 316us (4181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403485.793784:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:3.0:1784403485.798178:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403485.798798:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240976512 00000100:00100000:0.0:1784403485.798810:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240976512 00000100:00100000:0.0:1784403485.798912:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:0.0:1784403485.798924:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+8:13735:x1871082240976512:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784403485.798941:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403485.798963:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afba93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eebd expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403485.798997:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afba93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eebd expref: 9 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403485.799007:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce5a00/0x6828175665afba93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eebd expref: 9 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403485.799016:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5a00, rc 0) 00000100:00100000:0.0:1784403485.799079:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+9:13735:x1871082240976512:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 158us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403485.799086:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:2.0:1784403485.813091:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403485.813197:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240976640 00000100:00100000:3.0:1784403485.813209:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240976640 00000100:00100000:3.0:1784403485.813275:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:3.0:1784403485.813287:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+9:13735:x1871082240976640:12345-192.168.204.28@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784403485.813316:0:14789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784403485.813342:0:14789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784403485.813346:0:14789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784403485.813349:0:14789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784403485.813351:0:14789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1784403485.816093:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+9:13735:x1871082240976640:12345-192.168.204.28@tcp:256:mount.lustre.0 Request processed in 2796us (3004us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403485.816109:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:1.0:1784403485.819490:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403485.821717:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240976768 00000100:00100000:3.0:1784403485.821732:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240976768 00000100:00100000:3.0:1784403485.821809:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:3.0:1784403485.821820:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+9:13735:x1871082240976768:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784403485.821837:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403485.821922:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afba9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eec4 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403485.821958:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afba9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eec4 expref: 10 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403485.821970:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afba9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eec4 expref: 10 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403485.821978:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6c00, rc 0) 00000100:00100000:3.0:1784403485.822052:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+10:13735:x1871082240976768:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 233us (2573us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403485.822059:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:3.0:1784403485.831160:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403485.832282:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240976896 00000100:00100000:2.0:1784403485.832296:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240976896 00000100:00100000:2.0:1784403485.832409:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:2.0:1784403485.832421:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+10:13735:x1871082240976896:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784403485.832758:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+10:13735:x1871082240976896:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 338us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403485.832766:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:0.0:1784403485.839025:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403485.839130:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240977024 00000100:00100000:1.0:1784403485.839140:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240977024 00000100:00100000:1.0:1784403485.839194:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:1.0:1784403485.839204:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+10:13735:x1871082240977024:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784403485.839457:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+10:13735:x1871082240977024:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 254us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403485.839474:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:1.0:1784403485.843024:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403485.843122:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240977152 00000100:00100000:0.0:1784403485.843133:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240977152 00000100:00100000:0.0:1784403485.843183:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:0.0:1784403485.843192:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+10:13759:x1871082240977152:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784403485.843785:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+10:13759:x1871082240977152:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 591us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403485.843794:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:0.0:1784403485.851797:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403485.854182:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240977280 00000100:00100000:2.0:1784403485.854199:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240977280 00000100:00100000:2.0:1784403485.854594:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:2.0:1784403485.854607:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+10:13759:x1871082240977280:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784403485.854972:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+10:13759:x1871082240977280:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 362us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403485.854989:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:2.0:1784403485.862163:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403485.862566:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240977408 00000100:00100000:3.0:1784403485.862578:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240977408 00000100:00100000:3.0:1784403485.862635:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:3.0:1784403485.862645:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1871082240977408:12345-192.168.204.28@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784403485.862679:0:14796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 9791971e-5366-412b-99ee-4875c7fc85e0@192.168.204.28@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:3.0:1784403485.862735:0:14796:0:(genops.c:1385:class_connect()) connect: client 9791971e-5366-412b-99ee-4875c7fc85e0, cookie 0x6828175665afbaa1 00000004:00100000:3.0:1784403485.862770:0:14796:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1784403485.862777:0:14796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1784403485.949935:0:14796:0:(import.c:65:import_set_state_nolock()) ffff8c89435d6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784403485.950012:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+6:2357:x1871082240977408:12345-192.168.204.28@tcp:38:mount.lustre.0 Request processed in 87366us (87859us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403485.950024:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:2.0:1784403485.960772:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403485.960892:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403485.961181:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240977664 00000100:00100000:0.0:1784403485.961193:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240977664 00000100:00100000:0.0:1784403485.961287:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240977536 00000100:00100000:0.0:1784403485.961290:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240977536 00000100:00100000:0.0:1784403485.961311:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:0.0:1784403485.961320:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+7:13735:x1871082240977664:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784403485.961367:0:14798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784403485.961454:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+7:13735:x1871082240977664:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 135us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403485.961462:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:0.0:1784403485.961481:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:0.0:1784403485.961488:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+6:0:x1871082240977536:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784403485.961500:0:14798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784403485.961523:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+6:0:x1871082240977536:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 35us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403485.961529:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00080000:2.0:1784403485.962168:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403485.965082:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403485.972037:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240977792 00000100:00100000:2.0:1784403485.972128:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240977792 00000100:00100000:2.0:1784403485.972420:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1784403485.972433:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+6:13735:x1871082240977792:12345-192.168.204.28@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784403485.972558:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+6:13735:x1871082240977792:12345-192.168.204.28@tcp:40:mount.lustre.0 Request processed in 127us (7484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403485.972566:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1784403485.977797:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403485.977930:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403485.979829:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403485.980059:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240978176 00000100:00100000:0.0:1784403485.980071:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240978176 00000100:00100000:0.0:1784403485.980131:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:0.0:1784403485.980141:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9791971e-5366-412b-99ee-4875c7fc85e0+6:13735:x1871082240978176:12345-192.168.204.28@tcp:33:mount.lustre.0 00000004:00080000:0.0:1784403485.980737:0:14799:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 516us 00000100:00100000:3.0:1784403485.984015:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240977920 00000100:00100000:3.0:1784403485.984054:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240977920 00000100:00100000:3.0:1784403485.984116:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240978048 00000100:00100000:3.0:1784403485.984120:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240978048 00000100:00100000:3.0:1784403485.984148:0:15430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:3.0:1784403485.984158:0:15430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1871082240977920:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784403485.984195:0:15430:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 9791971e-5366-412b-99ee-4875c7fc85e0@192.168.204.28@tcp t0 exp 0000000000000000 cur 491 last 0 00000100:00100000:2.0:1784403485.984286:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1784403485.984293:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1871082240978048:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784403485.984311:0:15768:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 9791971e-5366-412b-99ee-4875c7fc85e0@192.168.204.28@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:2.0:1784403485.984345:0:15768:0:(genops.c:1385:class_connect()) connect: client 9791971e-5366-412b-99ee-4875c7fc85e0, cookie 0x6828175665afbaa8 00002000:00100000:2.0:1784403485.984358:0:15768:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9791971e-5366-412b-99ee-4875c7fc85e0/ffff8c8a506ba000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784403485.984383:0:15768:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784403485.984802:0:15768:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784403485.984849:0:15768:0:(import.c:65:import_set_state_nolock()) ffff8c8a506bb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784403485.984971:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9791971e-5366-412b-99ee-4875c7fc85e0+6:2357:x1871082240978048:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 675us (7039us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403485.984988:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000020:00000080:3.0:1784403485.986650:0:15430:0:(genops.c:1385:class_connect()) connect: client 9791971e-5366-412b-99ee-4875c7fc85e0, cookie 0x6828175665afbaaf 00002000:00100000:3.0:1784403485.986669:0:15430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9791971e-5366-412b-99ee-4875c7fc85e0/ffff8c89435d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784403485.986685:0:15430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784403485.987152:0:15430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784403485.987192:0:15430:0:(import.c:65:import_set_state_nolock()) ffff8c89435d2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784403485.991180:0:15430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9791971e-5366-412b-99ee-4875c7fc85e0+6:2357:x1871082240977920:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 7010us (13382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403485.991194:0:15430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000004:00200000:2.0:1784403486.003431:0:14799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1784403486.003631:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9791971e-5366-412b-99ee-4875c7fc85e0+6:13735:x1871082240978176:12345-192.168.204.28@tcp:33:mount.lustre.0 Request processed in 23484us (23802us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403486.003647:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:2.0:1784403486.228382:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403486.231956:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240978304 00000100:00100000:3.0:1784403486.231972:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240978304 00000100:00100000:2.0:1784403486.234146:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:2.0:1784403486.234162:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+6:13780:x1871082240978304:12345-192.168.204.28@tcp:101:mkdir.0 00010000:00010000:2.0:1784403486.234185:0:14797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403486.234263:0:14797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eeee expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403486.234341:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbabd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403486.234356:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbabd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403486.234372:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbabd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403486.236195:0:14797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784403486.236205:0:14797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403486.236397:0:14797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbabd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403486.236442:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eeee expref: 8 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403486.236477:0:14797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbabd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eeee expref: 7 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403486.236485:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a58960b00) 00010000:00010000:2.0:1784403486.236488:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784403486.236492:0:14797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2e00, rc 0) 00000100:00100000:2.0:1784403486.237189:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+7:13780:x1871082240978304:12345-192.168.204.28@tcp:101:mkdir.0 Request processed in 3024us (8810us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403486.237201:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00010000:00010000:2.0:1784403486.431108:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784403486.880389:0:14830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784403487.455249:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403487.463011:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784403487.463043:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260896256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784403487.463125:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403487.469098:0:15433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260896256 00000100:00100000:3.0:1784403487.469110:0:15433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260896256 00000100:00100000:3.0:1784403487.469178:0:15433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784403487.469189:0:15433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260896256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403487.469229:0:15433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403487.469311:0:15433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3565:x1871082260896256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (6186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403487.469329:0:15433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784403487.469362:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260896768:0@lo:400:kworker.0 00000100:00100000:3.0:1784403487.469404:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403487.469435:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784403487.469440:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260896640:0@lo:400:kworker.0 00000100:00100000:3.0:1784403487.469477:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403487.469505:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260896512:0@lo:400:kworker.0 00000100:00100000:3.0:1784403487.469531:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403487.469549:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784403487.469555:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:001064a9-3cb5-489b-ba0a-bb457082004b:3568:1871082260896384:0@lo:400:kworker.0 00000100:00100000:3.0:1784403487.471883:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403487.471949:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260896896:0@lo:400:kworker.0 00000100:00100000:3.0:1784403487.472026:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403487.472112:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260896256:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784403487.472183:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784403487.473482:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260896768 00000100:00100000:1.0:1784403487.473494:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260896768 00000100:00100000:2.0:1784403487.473513:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260896640 00000100:00100000:2.0:1784403487.473517:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260896640 00000100:00100000:0.0:1784403487.475190:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260896384 00000100:00100000:0.0:1784403487.475204:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260896384 00000100:00100000:0.0:1784403487.475272:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784403487.475282:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+19:3568:x1871082260896384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403487.475383:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+19:3568:x1871082260896384:12345-0@lo:400:kworker.0 Request processed in 103us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403487.475391:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784403487.477891:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260896896 00000100:00100000:1.0:1784403487.477906:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260896896 00000100:00100000:1.0:1784403487.477953:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784403487.477962:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260896768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403487.478334:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260896768:12345-0@lo:400:kworker.0 Request processed in 372us (8927us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403487.478344:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784403487.478363:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784403487.478370:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260896896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403487.478402:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3568:x1871082260896896:12345-0@lo:400:kworker.0 Request processed in 34us (6388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403487.478407:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1784403487.478431:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784403487.478479:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260896768:0@lo:400:kworker.0 00000100:00100000:1.0:1784403487.478525:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784403487.478532:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260896640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403487.478571:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3566:x1871082260896640:12345-0@lo:400:kworker.0 Request processed in 40us (9092us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403487.479910:0:15768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260896512 00000100:00100000:2.0:1784403487.479922:0:15768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260896512 00000100:00100000:0.0:1784403487.480137:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:001064a9-3cb5-489b-ba0a-bb457082004b:3568:1871082260896384:0@lo:400:kworker.0 00000100:00100000:0.0:1784403487.480184:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3568:1871082260896896:0@lo:400:kworker.0 00000100:00100000:0.0:1784403487.480260:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3566:1871082260896640:0@lo:400:kworker.0 00000100:00080000:0.0:1784403487.480284:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403487.480309:0:15431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784403487.480320:0:15431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260896512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403487.480397:0:15431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260896512:12345-0@lo:400:kworker.0 Request processed in 78us (10863us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403487.480404:0:15431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784403487.480431:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260896512:0@lo:400:kworker.0 00000100:00100000:1.0:1784403487.486374:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000001:00100000:1.0:1784403487.663479:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9791971e-5366-412b-99ee-4875c7fc85e0 00000001:00080000:1.0:1784403487.663500:0:8006:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:2.0:1784403488.113446:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403488.113712:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240978432 00000100:00100000:0.0:1784403488.113723:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240978432 00000100:00100000:0.0:1784403488.113924:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:0.0:1784403488.113936:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+7:13832:x1871082240978432:12345-192.168.204.28@tcp:41:lfs.0 00000004:00000024:0.0:1784403488.113982:0:14798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784403488.114079:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+7:13832:x1871082240978432:12345-192.168.204.28@tcp:41:lfs.0 Request processed in 144us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403488.114118:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00080000:1.0:1784403488.114819:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403488.119863:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.119984:0:15433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240978560 00000100:00100000:3.0:1784403488.119995:0:15433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240978560 00000100:00080000:1.0:1784403488.120074:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403488.120087:0:15433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:3.0:1784403488.120101:0:15433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9791971e-5366-412b-99ee-4875c7fc85e0+6:13832:x1871082240978560:12345-192.168.204.28@tcp:13:lfs.0 00002000:00000024:3.0:1784403488.120144:0:15433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403488.120238:0:15433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9791971e-5366-412b-99ee-4875c7fc85e0+6:13832:x1871082240978560:12345-192.168.204.28@tcp:13:lfs.0 Request processed in 140us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403488.120246:0:15433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:3.0:1784403488.123226:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403488.123352:0:15433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240978688 00000100:00100000:2.0:1784403488.123362:0:15433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240978688 00000100:00080000:1.0:1784403488.123520:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784403488.123637:0:15433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1784403488.123649:0:15433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9791971e-5366-412b-99ee-4875c7fc85e0+5:13832:x1871082240978688:12345-192.168.204.28@tcp:13:lfs.0 00002000:00000024:2.0:1784403488.123674:0:15433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403488.123763:0:15433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9791971e-5366-412b-99ee-4875c7fc85e0+5:13832:x1871082240978688:12345-192.168.204.28@tcp:13:lfs.0 Request processed in 116us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403488.123771:0:15433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1784403488.314244:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.314542:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240978816 00000100:00100000:3.0:1784403488.314553:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240978816 00000100:00100000:3.0:1784403488.314630:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:3.0:1784403488.314643:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fd1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+10:13863:x1871082240978816:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784403488.314661:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403488.315901:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6e00/0x6828175665afbac4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eef5 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403488.315961:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6e00/0x6828175665afbac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eef5 expref: 11 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403488.315976:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6e00/0x6828175665afbac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eef5 expref: 11 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403488.315986:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6e00, rc 0) 00000100:00100000:3.0:1784403488.316066:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fd1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+11:13863:x1871082240978816:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 1424us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403488.316083:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:3.0:1784403488.329116:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403488.329472:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240978944 00000100:00100000:0.0:1784403488.329484:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240978944 00000100:00100000:0.0:1784403488.329562:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00100000:0.0:1784403488.329572:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a433fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+11:13863:x1871082240978944:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784403488.331029:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a433fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+11:13863:x1871082240978944:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 1450us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403488.331042:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00100000:2.0:1784403488.336432:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.337608:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240979072 00000100:00100000:3.0:1784403488.337621:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240979072 00000100:00100000:3.0:1784403488.337682:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:3.0:1784403488.337693:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a433f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+11:13863:x1871082240979072:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784403488.337993:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a433f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+11:13863:x1871082240979072:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 301us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403488.338002:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:2.0:1784403488.369592:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403488.370791:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240979200 00000100:00100000:0.0:1784403488.370806:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240979200 00000100:00100000:0.0:1784403488.370929:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:0.0:1784403488.370940:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+11:13870:x1871082240979200:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784403488.371515:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+11:13870:x1871082240979200:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 573us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403488.371525:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:0.0:1784403488.420108:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403488.427388:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240979328 00000100:00100000:2.0:1784403488.427404:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240979328 00000100:00100000:2.0:1784403488.427551:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 94 00000100:00100000:2.0:1784403488.427568:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+11:13870:x1871082240979328:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784403488.428001:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+11:13870:x1871082240979328:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 436us (7901us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403488.428009:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 94 00000100:00100000:2.0:1784403488.434031:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403488.434246:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240979456 00000100:00100000:0.0:1784403488.434257:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240979456 00000100:00100000:0.0:1784403488.434323:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:0.0:1784403488.434334:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+11:13863:x1871082240979456:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784403488.434366:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403488.434388:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce5400/0x6828175665afbacb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef1f expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403488.434421:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce5400/0x6828175665afbacb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef1f expref: 12 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403488.434434:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce5400/0x6828175665afbacb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef1f expref: 12 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403488.434444:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5400, rc 0) 00000100:00100000:0.0:1784403488.434516:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+12:13863:x1871082240979456:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 184us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403488.434523:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:0.0:1784403488.441639:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.442199:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240979584 00000100:00100000:3.0:1784403488.442225:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240979584 00000100:00100000:3.0:1784403488.442287:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 96 00000100:00100000:3.0:1784403488.442298:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+12:13863:x1871082240979584:12345-192.168.204.28@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784403488.442326:0:14791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784403488.442344:0:14791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784403488.442348:0:14791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784403488.442352:0:14791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784403488.442355:0:14791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1784403488.445980:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+12:13863:x1871082240979584:12345-192.168.204.28@tcp:256:mount.lustre.0 Request processed in 3671us (4339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403488.445995:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 96 00000100:00100000:1.0:1784403488.451217:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.451348:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240979712 00000100:00100000:3.0:1784403488.451358:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240979712 00000100:00100000:3.0:1784403488.451474:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:3.0:1784403488.451485:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+12:13863:x1871082240979712:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784403488.451503:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403488.451524:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afbad2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef26 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403488.451555:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afbad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef26 expref: 13 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403488.451565:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afbad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef26 expref: 13 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403488.451574:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6a00, rc 0) 00000100:00100000:3.0:1784403488.451647:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+13:13863:x1871082240979712:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 163us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403488.451671:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:0.0:1784403488.457495:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.457585:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240979840 00000100:00100000:3.0:1784403488.457596:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240979840 00000100:00100000:3.0:1784403488.457703:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:3.0:1784403488.457715:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+13:13863:x1871082240979840:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784403488.458081:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+13:13863:x1871082240979840:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 365us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403488.458089:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:1.0:1784403488.459662:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.459795:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240979968 00000100:00100000:3.0:1784403488.459804:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240979968 00000100:00100000:3.0:1784403488.459930:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00100000:3.0:1784403488.459942:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+13:13863:x1871082240979968:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784403488.460269:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+13:13863:x1871082240979968:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 327us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403488.460277:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00100000:1.0:1784403488.473002:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.479203:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240980096 00000100:00100000:3.0:1784403488.479218:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240980096 00000100:00100000:3.0:1784403488.479296:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 100 00000100:00100000:3.0:1784403488.479306:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+13:13876:x1871082240980096:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784403488.480148:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+13:13876:x1871082240980096:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 839us (7564us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403488.480159:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 100 00010000:00010000:2.0:1784403488.480275:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403488.489197:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.489319:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240980224 00000100:00100000:3.0:1784403488.489330:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240980224 00000100:00100000:3.0:1784403488.489403:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00100000:3.0:1784403488.489415:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+13:13876:x1871082240980224:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784403488.489723:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+13:13876:x1871082240980224:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 306us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403488.489735:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00100000:0.0:1784403488.501244:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403488.508972:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240980352 00000100:00100000:1.0:1784403488.508990:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240980352 00000100:00100000:1.0:1784403488.509045:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:1.0:1784403488.509054:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1871082240980352:12345-192.168.204.28@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784403488.509096:0:14796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from a6f18205-6d4d-463b-9cd7-d615580287c7@192.168.204.28@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:1.0:1784403488.509148:0:14796:0:(genops.c:1385:class_connect()) connect: client a6f18205-6d4d-463b-9cd7-d615580287c7, cookie 0x6828175665afbad9 00000004:00100000:1.0:1784403488.509182:0:14796:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784403488.509311:0:14796:0:(import.c:65:import_set_state_nolock()) ffff8c89419de000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784403488.509393:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+6:2357:x1871082240980352:12345-192.168.204.28@tcp:38:mount.lustre.0 Request processed in 337us (8157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403488.509402:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:1.0:1784403488.515858:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403488.516707:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240980608 00000100:00100000:2.0:1784403488.516720:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240980608 00000100:00100000:2.0:1784403488.516804:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:2.0:1784403488.516814:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+6:13863:x1871082240980608:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784403488.516892:0:14797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1784403488.517036:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403488.517280:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+6:13863:x1871082240980608:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 464us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403488.517289:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1784403488.524599:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403488.524903:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240980480 00000100:00100000:1.0:1784403488.524916:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240980480 00000100:00100000:1.0:1784403488.524995:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1784403488.525006:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+6:0:x1871082240980480:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784403488.525038:0:14798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784403488.525309:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+6:0:x1871082240980480:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 303us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403488.525330:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:3.0:1784403488.529281:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403488.532351:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240980736 00000100:00100000:1.0:1784403488.532368:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240980736 00000100:00100000:1.0:1784403488.532453:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:1.0:1784403488.532463:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+6:13863:x1871082240980736:12345-192.168.204.28@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784403488.532566:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+6:13863:x1871082240980736:12345-192.168.204.28@tcp:40:mount.lustre.0 Request processed in 105us (3297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403488.532573:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:3.0:1784403488.536568:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.536611:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403488.536644:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403488.536827:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240981120 00000100:00100000:2.0:1784403488.536848:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240981120 00000100:00100000:2.0:1784403488.536946:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:2.0:1784403488.536957:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+6:13863:x1871082240981120:12345-192.168.204.28@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784403488.537235:0:14800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1784403488.537393:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+6:13863:x1871082240981120:12345-192.168.204.28@tcp:33:mount.lustre.0 Request processed in 436us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403488.537410:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:1.0:1784403488.538350:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240980864 00000100:00100000:1.0:1784403488.538359:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240980864 00000100:00100000:1.0:1784403488.538390:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240980992 00000100:00100000:1.0:1784403488.538393:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240980992 00000100:00100000:1.0:1784403488.538413:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:1.0:1784403488.538419:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1871082240980864:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784403488.538449:0:15429:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a6f18205-6d4d-463b-9cd7-d615580287c7@192.168.204.28@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:1.0:1784403488.538483:0:15429:0:(genops.c:1385:class_connect()) connect: client a6f18205-6d4d-463b-9cd7-d615580287c7, cookie 0x6828175665afbae0 00002000:00100000:1.0:1784403488.538495:0:15429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a6f18205-6d4d-463b-9cd7-d615580287c7/ffff8c89419db800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784403488.538507:0:15429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1784403488.539378:0:15431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:2.0:1784403488.539387:0:15431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1871082240980992:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784403488.539414:0:15431:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from a6f18205-6d4d-463b-9cd7-d615580287c7@192.168.204.28@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:2.0:1784403488.539439:0:15431:0:(genops.c:1385:class_connect()) connect: client a6f18205-6d4d-463b-9cd7-d615580287c7, cookie 0x6828175665afbae7 00002000:00100000:2.0:1784403488.539448:0:15431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a6f18205-6d4d-463b-9cd7-d615580287c7/ffff8c8a506bf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784403488.539457:0:15431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784403488.539671:0:15431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784403488.539708:0:15431:0:(import.c:65:import_set_state_nolock()) ffff8c8a506bc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784403488.539771:0:15431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+6:2357:x1871082240980992:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 383us (3125us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403488.539779:0:15431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00002000:00080000:1.0:1784403488.540164:0:15429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784403488.540183:0:15429:0:(import.c:65:import_set_state_nolock()) ffff8c89419d9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784403488.540227:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+6:2357:x1871082240980864:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 1806us (3614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403488.540235:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:2.0:1784403488.696308:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403488.696421:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240981248 00000100:00100000:1.0:1784403488.696433:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240981248 00000100:00100000:1.0:1784403488.696528:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:1.0:1784403488.696551:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+6:13897:x1871082240981248:12345-192.168.204.28@tcp:101:mkdir.0 00010000:00010000:1.0:1784403488.696575:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403488.696600:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbaee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef50 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403488.696679:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403488.696695:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403488.696709:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403488.696969:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784403488.696975:0:14798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403488.697062:0:14798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403488.697089:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbaee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef50 expref: 8 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403488.697106:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef50 expref: 7 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403488.697115:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a58960b00) 00010000:00010000:1.0:1784403488.697118:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784403488.697122:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1600, rc 0) 00000100:00100000:1.0:1784403488.697179:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+7:13897:x1871082240981248:12345-192.168.204.28@tcp:101:mkdir.0 Request processed in 635us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403488.697192:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00010000:00010000:2.0:1784403489.507384:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403490.528261:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8943275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260897024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784403490.528342:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784403490.528940:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403490.530840:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260897024 00000100:00100000:0.0:1784403490.530855:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260897024 00000100:00100000:0.0:1784403490.531054:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784403490.531066:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260897024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784403490.531109:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784403490.531195:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260897024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403490.531202:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784403490.531257:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8943275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260897024:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784403490.532740:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1784403490.622358:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a6f18205-6d4d-463b-9cd7-d615580287c7 00000001:00100000:1.0:1784403490.622377:0:7124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9791971e-5366-412b-99ee-4875c7fc85e0 00000001:00100000:2.0:1784403491.105149:0:6314:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a6f18205-6d4d-463b-9cd7-d615580287c7 00000001:00100000:2.0:1784403491.105166:0:6314:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9791971e-5366-412b-99ee-4875c7fc85e0 00010000:00010000:2.0:1784403491.551149:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784403491.909148:0:16667:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1784403492.576194:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7af43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260897152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784403492.576274:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784403492.577518:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403492.577889:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260897152 00000100:00100000:3.0:1784403492.577900:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260897152 00000100:00100000:3.0:1784403492.577977:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784403492.577988:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260897152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784403492.578026:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784403492.578101:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260897152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403492.578108:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784403492.578157:0:3565:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1784403492.578184:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7af43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260897152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403492.579216:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260897408:0@lo:400:kworker.0 00000100:00100000:1.0:1784403492.579268:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403492.579303:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784403492.579308:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260897536:0@lo:400:kworker.0 00000100:00100000:1.0:1784403492.579335:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403492.579367:0:15431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260897408 00000100:00100000:1.0:1784403492.579372:0:15431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260897408 00000100:00100000:1.0:1784403492.579414:0:15431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784403492.579424:0:15431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260897408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403492.579515:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:001064a9-3cb5-489b-ba0a-bb457082004b:3566:1871082260897280:0@lo:400:kworker.0 00000100:00100000:0.0:1784403492.579771:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403492.579798:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260897792:0@lo:400:kworker.0 00000100:00100000:0.0:1784403492.579823:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403492.579845:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784403492.579850:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260897664:0@lo:400:kworker.0 00000100:00100000:0.0:1784403492.579899:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403492.579953:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260897536 00000100:00100000:0.0:1784403492.579957:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260897536 00000100:00100000:0.0:1784403492.579980:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260897792 00000100:00100000:0.0:1784403492.579982:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260897792 00000100:00100000:1.0:1784403492.579996:0:15431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260897408:12345-0@lo:400:kworker.0 Request processed in 573us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403492.580004:0:15431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784403492.580010:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260897664 00000100:00100000:0.0:1784403492.580012:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260897664 00000100:00100000:0.0:1784403492.580026:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784403492.580030:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784403492.580033:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260897536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403492.580037:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784403492.580079:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3567:x1871082260897536:12345-0@lo:400:kworker.0 Request processed in 46us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403492.580085:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784403492.580099:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784403492.580105:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260897792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784403492.580133:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260897792:12345-0@lo:400:kworker.0 Request processed in 29us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403492.580139:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784403492.580149:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784403492.580160:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260897664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403492.580304:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3567:1871082260897536:0@lo:400:kworker.0 00000100:00100000:1.0:1784403492.580316:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260897408:0@lo:400:kworker.0 00000100:00100000:0.0:1784403492.580325:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260897664:12345-0@lo:400:kworker.0 Request processed in 29us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403492.580332:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784403492.580356:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260897664:0@lo:400:kworker.0 00000100:00100000:0.0:1784403492.580366:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260897792:0@lo:400:kworker.0 00000100:00100000:3.0:1784403492.580779:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260897280 00000100:00100000:3.0:1784403492.580784:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260897280 00000100:00100000:3.0:1784403492.580818:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784403492.580826:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+19:3566:x1871082260897280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403492.580916:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+19:3566:x1871082260897280:12345-0@lo:400:kworker.0 Request processed in 90us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403492.580933:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784403492.582116:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:001064a9-3cb5-489b-ba0a-bb457082004b:3566:1871082260897280:0@lo:400:kworker.0 00000100:00080000:2.0:1784403492.582278:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784403492.582286:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784403492.582289:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1784403492.635240:0:8006:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a6f18205-6d4d-463b-9cd7-d615580287c7 00010000:00010000:0.0:1784403493.599163:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403493.950814:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403493.950897:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403493.950929:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403493.950965:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403493.950986:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403493.951008:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403493.951037:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403493.951076:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240981504 00000100:00100000:2.0:1784403493.951087:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240981504 00000100:00100000:2.0:1784403493.951152:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240981888 00000100:00100000:2.0:1784403493.951156:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240981888 00000100:00100000:2.0:1784403493.951187:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1784403493.951198:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+6:2358:x1871082240981504:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403493.951281:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+6:2358:x1871082240981504:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 84us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403493.951290:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1784403493.951312:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1784403493.951319:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+6:2359:x1871082240981888:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403493.951345:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+6:2359:x1871082240981888:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403493.951351:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1784403493.951372:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240981760 00000100:00100000:2.0:1784403493.951375:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240981760 00000100:00100000:2.0:1784403493.951397:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240982016 00000100:00100000:2.0:1784403493.951400:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240982016 00000100:00100000:2.0:1784403493.951414:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240981632 00000100:00100000:2.0:1784403493.951417:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240981632 00000100:00100000:2.0:1784403493.951429:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240982144 00000100:00100000:2.0:1784403493.951431:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240982144 00000100:00100000:2.0:1784403493.951444:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:2.0:1784403493.951450:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9791971e-5366-412b-99ee-4875c7fc85e0+5:2358:x1871082240981760:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403493.951490:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9791971e-5366-412b-99ee-4875c7fc85e0+5:2358:x1871082240981760:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 38us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403493.951497:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:2.0:1784403493.951509:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:2.0:1784403493.952763:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2358:x1871082240982016:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403493.952831:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2358:x1871082240982016:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 1312us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403493.952840:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:2.0:1784403493.952882:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:2.0:1784403493.952893:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9791971e-5366-412b-99ee-4875c7fc85e0+5:2359:x1871082240981632:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403493.952922:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9791971e-5366-412b-99ee-4875c7fc85e0+5:2359:x1871082240981632:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 32us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403493.952928:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:2.0:1784403493.952942:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1784403493.952949:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2359:x1871082240982144:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403493.952974:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2359:x1871082240982144:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 26us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403493.952980:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00080000:2.0:1784403493.953023:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784403493.953029:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403493.953032:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403493.954085:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240981376 00000100:00100000:0.0:1784403493.954097:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240981376 00000100:00100000:0.0:1784403493.954151:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 103 00000100:00100000:0.0:1784403493.954160:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+13:2359:x1871082240981376:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403493.954203:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+13:2359:x1871082240981376:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 44us (3401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403493.954210:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 103 00010000:00010000:2.0:1784403494.623204:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784403495.561827:0:16816:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff254ddf00 20000000:00000080:3.0:1784403495.561846:0:16816:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c8a7d177c00 uarg=0000000000000000 20000000:01000000:3.0:1784403495.561924:0:16816:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784403495.561930:0:16816:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784403495.561935:0:16816:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784403495.564951:0:16817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1784403495.565205:0:16816:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1784403495.575034:0:16816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784403495.575093:0:16816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575116:0:16816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7b5b3000/0x6828175665afb7f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb7ec expref: 18 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575124:0:16816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afb840 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb839 expref: 18 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575151:0:16816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce5600/0x6828175665afb974 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afb96d expref: 18 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575160:0:16816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afba9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eec4 expref: 12 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575167:0:16816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afbad2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef26 expref: 12 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575175:0:16816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575230:0:16816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afbad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef26 expref: 12 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575246:0:16816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afbad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef26 expref: 12 pid: 14789 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403495.575264:0:16816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16816:1871082260897920:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403495.575387:0:16816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afba9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eec4 expref: 12 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575396:0:16816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afba9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eec4 expref: 12 pid: 14792 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403495.575407:0:16816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16816:1871082260898048:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403495.575443:0:16816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce5600/0x6828175665afb974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afb96d expref: 18 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575461:0:16816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7fce5600/0x6828175665afb974 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afb96d expref: 18 pid: 14789 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403495.575471:0:16816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16816:1871082260898176:0@lo:104: 00000100:00100000:0.0:1784403495.575529:0:16816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784403495.575574:0:16816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afb840 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afb839 expref: 18 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575582:0:16816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afb840 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afb839 expref: 18 pid: 14791 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403495.575590:0:16816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e18700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16816:1871082260898304:0@lo:104: 00000100:00100000:0.0:1784403495.575609:0:16816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784403495.575626:0:16816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c8a7b5b3000/0x6828175665afb7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6828175665afb7ec expref: 18 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.575633:0:16816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c8a7b5b3000/0x6828175665afb7f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6828175665afb7ec expref: 18 pid: 14791 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403495.575641:0:16816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e19f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16816:1871082260898432:0@lo:104: 00000100:00100000:0.0:1784403495.575662:0:16816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403495.575671:0:16816:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a522716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784403495.575769:0:14780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784403495.575784:0:14780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260898176 00000100:00100000:1.0:1784403495.575799:0:14780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260898176 00000100:00100000:1.0:1784403495.575842:0:14780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260898304 00000100:00100000:1.0:1784403495.575845:0:14780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260898304 00000100:00100000:1.0:1784403495.575856:0:14780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260898432 00000100:00100000:1.0:1784403495.575859:0:14780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260898432 00000100:00100000:1.0:1784403495.575893:0:14780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784403495.575901:0:14780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+5:16816:x1871082260898176:12345-0@lo:104: 00010000:00010000:1.0:1784403495.575913:0:14780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.575971:0:14780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784403495.575977:0:14780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+5:16816:x1871082260898176:12345-0@lo:104: Request processed in 77us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403495.575984:0:14780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784403495.576001:0:14780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784403495.576007:0:14780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+4:16816:x1871082260898304:12345-0@lo:104: 00010000:00010000:1.0:1784403495.576015:0:14780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576059:0:14780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784403495.576064:0:14780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+4:16816:x1871082260898304:12345-0@lo:104: Request processed in 58us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403495.576073:0:14780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784403495.576090:0:14780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403495.576095:0:14780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a431f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+3:16816:x1871082260898432:12345-0@lo:104: 00010000:00010000:1.0:1784403495.576101:0:14780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576133:0:14780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784403495.576144:0:14780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a431f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:001064a9-3cb5-489b-ba0a-bb457082004b+3:16816:x1871082260898432:12345-0@lo:104: Request processed in 49us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403495.576150:0:14780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1784403495.576198:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784403495.576205:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576214:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3600 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403495.576218:0:15770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576226:0:15770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403495.576234:0:15770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403495.576239:0:15770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784403495.576290:0:15770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576296:0:15770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403495.576316:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576324:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b3600/0x6828175665afb96d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb974 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576337:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784403495.576340:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576357:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4a00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403495.576361:0:15770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576367:0:15770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403495.576373:0:15770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403495.576378:0:15770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784403495.576392:0:15770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576398:0:15770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403495.576404:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576409:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce4a00/0x6828175665afb839 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb840 expref: -99 pid: 15428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576417:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403495.576420:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576426:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1e00 already unused, calling callback (ffffffffc1ab5c20) 10000000:00010000:1.0:1784403495.576428:0:15770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576443:0:15770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784403495.576449:0:15770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784403495.576453:0:15770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784403495.576465:0:15770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576470:0:15770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784403495.576486:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576493:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8c8a734a1e00/0x6828175665afb7ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6828175665afb7f3 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576505:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403495.576507:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403495.576509:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403495.576515:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403495.576533:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260898560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403495.576565:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403495.576596:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784403495.576603:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260898688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403495.576626:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403495.576653:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:001064a9-3cb5-489b-ba0a-bb457082004b:3565:1871082260898816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403495.576675:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403495.576728:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260898560 00000100:00100000:1.0:1784403495.576733:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260898560 00010000:00010000:1.0:1784403495.576755:0:14784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce5600/0x6828175665afb974 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb96d expref: 19 pid: 14789 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403495.576769:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260898688 00000100:00100000:1.0:1784403495.576771:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260898688 00010000:00010000:1.0:1784403495.576780:0:14784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afb840 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb839 expref: 20 pid: 14791 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403495.576789:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260898816 00000100:00100000:1.0:1784403495.576792:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260898816 00010000:00010000:1.0:1784403495.576801:0:14784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7b5b3000/0x6828175665afb7f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb7ec expref: 21 pid: 14791 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403495.576811:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784403495.576817:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:001064a9-3cb5-489b-ba0a-bb457082004b+21:3567:x1871082260898560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403495.576827:0:14784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403495.576832:0:14784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce5600/0x6828175665afb974 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb96d expref: 21 pid: 14789 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576840:0:14784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce5600/0x6828175665afb974 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afb96d expref: 21 pid: 14789 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576855:0:14784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403495.576909:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:001064a9-3cb5-489b-ba0a-bb457082004b+21:3567:x1871082260898560:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403495.576915:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784403495.576929:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784403495.576935:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:001064a9-3cb5-489b-ba0a-bb457082004b+20:3567:x1871082260898688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403495.576951:0:14784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403495.576956:0:14784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afb840 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb839 expref: 20 pid: 14791 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576964:0:14784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afb840 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afb839 expref: 20 pid: 14791 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.576973:0:14784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403495.576994:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:001064a9-3cb5-489b-ba0a-bb457082004b+20:3567:x1871082260898688:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403495.577000:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784403495.577013:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403495.577019:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:001064a9-3cb5-489b-ba0a-bb457082004b+19:3565:x1871082260898816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784403495.577025:0:14784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403495.577029:0:14784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7b5b3000/0x6828175665afb7f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6828175665afb7ec expref: 19 pid: 14791 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.577037:0:14784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7b5b3000/0x6828175665afb7f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6828175665afb7ec expref: 19 pid: 14791 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.577047:0:14784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784403495.577070:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:001064a9-3cb5-489b-ba0a-bb457082004b+19:3565:x1871082260898816:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403495.577076:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784403495.577153:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:001064a9-3cb5-489b-ba0a-bb457082004b:3565:1871082260898816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403495.577176:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260898688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784403495.577183:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260898560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784403495.577493:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403495.577998:0:16816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce5600/0x6828175665afb974 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afb96d expref: 18 pid: 14789 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403495.578012:0:16816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16816:1871082260898176:0@lo:104: 00010000:00010000:1.0:1784403495.578025:0:16816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce7e00/0x6828175665afb840 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afb839 expref: 17 pid: 14791 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403495.578033:0:16816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e18700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16816:1871082260898304:0@lo:104: 00010000:00010000:1.0:1784403495.578044:0:16816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7b5b3000/0x6828175665afb7f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6828175665afb7ec expref: 16 pid: 14791 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403495.578052:0:16816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e19f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16816:1871082260898432:0@lo:104: 00000100:00100000:2.0:1784403495.589011:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403495.589103:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403495.589169:0:14782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240982272 00000100:00100000:2.0:1784403495.589179:0:14782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240982272 00000100:00100000:0.0:1784403495.589184:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240982400 00000100:00100000:0.0:1784403495.589187:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240982400 00010000:00010000:2.0:1784403495.589216:0:14782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afbad2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef26 expref: 14 pid: 14789 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403495.589216:0:14784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afba9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eec4 expref: 14 pid: 14792 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403495.589579:0:16816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16816:1871082260897920:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403495.589592:0:16816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16816:1871082260898048:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403495.589630:0:16816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403495.589957:0:14782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1784403495.589970:0:14782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c12d25a6-6fec-420f-abaf-beb60f397179+14:2360:x1871082240982272:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403495.589987:0:14782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403495.589994:0:14782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afbad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef26 expref: 14 pid: 14789 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590007:0:14782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afbad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef26 expref: 14 pid: 14789 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590027:0:14782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6a00/0x6828175665afbad2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef26 expref: 14 pid: 14789 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590041:0:14782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403495.590103:0:14782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c12d25a6-6fec-420f-abaf-beb60f397179+13:2360:x1871082240982272:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 136us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403495.590112:0:14782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1784403495.590133:0:14782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:2.0:1784403495.590141:0:14782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c12d25a6-6fec-420f-abaf-beb60f397179+12:2360:x1871082240982400:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403495.590149:0:14782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403495.590154:0:14782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afba9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eec4 expref: 12 pid: 14792 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590163:0:14782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afba9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eec4 expref: 12 pid: 14792 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590184:0:14782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce6c00/0x6828175665afba9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eec4 expref: 12 pid: 14792 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590196:0:14782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590205:0:14782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590222:0:14782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590230:0:14782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590237:0:14782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590244:0:14782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590251:0:14782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:2.0:1784403495.590255:0:14782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590264:0:14782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590282:0:14782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403495.590304:0:14782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403495.590326:0:14782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c12d25a6-6fec-420f-abaf-beb60f397179+11:2360:x1871082240982400:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 185us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403495.590333:0:14782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00010000:00010000:1.0:1784403495.590399:0:16816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.590407:0:16816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403495.590415:0:16816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c8a7fce5c00/0x6828175665afbafc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403495.648142:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260898944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784403495.648226:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403495.648764:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260898944 00000100:00100000:1.0:1784403495.648773:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260898944 00000100:00100000:1.0:1784403495.648852:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784403495.648880:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260898944:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784403495.648912:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1784403495.648920:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403495.649000:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260898944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403495.649022:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784403495.649051:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260898944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784403495.649071:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784403496.097617:0:14830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784403496.676089:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784403496.738571:0:14794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784403496.738580:0:14794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a506c2000 from 10 10000000:01000000:3.0:1784403496.738586:0:14794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784403496.738639:0:14794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6400/0x6828175665afbb03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403496.738654:0:14794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6400/0x6828175665afbb03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403496.738665:0:14794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6400/0x6828175665afbb03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403496.738705:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784403496.738788:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403496.738854:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a50321780 going to sleep for 11 seconds 00000100:00100000:0.0:1784403496.738998:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260899072 00000100:00100000:0.0:1784403496.739005:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260899072 00000100:00100000:0.0:1784403496.739073:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784403496.739081:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+16:14794:x1871082260899072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403496.739094:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403496.739120:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce4800/0x6828175665afbb0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afbb03 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403496.739143:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce4800/0x6828175665afbb0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afbb03 expref: 17 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403496.739152:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce4800/0x6828175665afbb0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afbb03 expref: 17 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403496.739160:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4800, rc 0) 00000100:00100000:0.0:1784403496.739214:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+17:14794:x1871082260899072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403496.739220:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784403496.739470:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403496.739494:0:14794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6400/0x6828175665afbb03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afbb0a expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403496.739503:0:14794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6400/0x6828175665afbb03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afbb0a expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403496.739561:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73604380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403496.739589:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403496.739623:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a50321780 going to sleep for 11 seconds 00000100:00100000:0.0:1784403496.739669:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260899200 00000100:00100000:0.0:1784403496.739674:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260899200 00000100:00100000:0.0:1784403496.739723:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784403496.739732:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+17:14794:x1871082260899200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403496.740024:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+17:14794:x1871082260899200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403496.740031:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784403496.740407:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73604380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403496.740450:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784403496.740696:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403496.740732:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403496.740784:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260899328 00000100:00100000:0.0:1784403496.740790:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260899328 00000100:00100000:0.0:1784403496.740829:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784403496.740839:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+17:14794:x1871082260899328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403496.741042:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+17:14794:x1871082260899328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403496.741055:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784403496.741140:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784403496.750684:0:16856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1784403496.751013:0:14794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1784403496.751039:0:14794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784403496.751050:0:14794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6400/0x6828175665afbb03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afbb0a expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403496.751061:0:14794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce6400/0x6828175665afbb03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afbb0a expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784403496.751073:0:14794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784403496.751075:0:14794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a5270a000 from 10 10000000:01000000:3.0:1784403496.751079:0:14794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784403496.751130:0:14794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7c00/0x6828175665afbb11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403496.751138:0:14794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7c00/0x6828175665afbb11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403496.751149:0:14794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7c00/0x6828175665afbb11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403496.751176:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784403496.751269:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403496.751347:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260899456 00000100:00100000:0.0:1784403496.751355:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260899456 00000100:00100000:0.0:1784403496.751417:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784403496.751426:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+17:14794:x1871082260899456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403496.751441:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403496.751457:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce5000/0x6828175665afbb18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afbb11 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403496.751475:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a503219c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784403496.751494:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce5000/0x6828175665afbb18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afbb11 expref: 18 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403496.751691:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce5000/0x6828175665afbb18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afbb11 expref: 18 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403496.751703:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5000, rc 0) 00000100:00100000:0.0:1784403496.751761:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+18:14794:x1871082260899456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 335us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403496.751769:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784403496.751927:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403496.751944:0:14794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7c00/0x6828175665afbb11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afbb18 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403496.751954:0:14794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7c00/0x6828175665afbb11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afbb18 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403496.752004:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403496.752031:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403496.752059:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a503219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403496.752141:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260899584 00000100:00100000:0.0:1784403496.752146:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260899584 00000100:00100000:0.0:1784403496.752187:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784403496.752194:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+18:14794:x1871082260899584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403496.752481:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+18:14794:x1871082260899584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403496.752490:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784403496.752542:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403496.752570:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403496.752611:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403496.752625:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a503219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784403496.752673:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260899712 00000100:00100000:0.0:1784403496.752692:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260899712 00000100:00100000:0.0:1784403496.752722:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784403496.752730:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+18:14794:x1871082260899712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403496.752903:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+18:14794:x1871082260899712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403496.752910:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784403496.752993:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784403496.756571:0:16858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1784403496.756657:0:14794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1784403496.756694:0:14794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784403496.756708:0:14794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7c00/0x6828175665afbb11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afbb18 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403496.756722:0:14794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7fce7c00/0x6828175665afbb11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afbb18 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784403496.756734:0:14794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784403496.756737:0:14794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c8a7303e800 from 10 10000000:01000000:2.0:1784403496.756740:0:14794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784403496.756779:0:14794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2c00/0x6828175665afbb1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403496.756788:0:14794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2c00/0x6828175665afbb1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403496.756799:0:14794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2c00/0x6828175665afbb1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403496.756842:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784403496.756944:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403496.756979:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fd300 going to sleep for 11 seconds 00000100:00100000:0.0:1784403496.757045:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260899840 00000100:00100000:0.0:1784403496.757052:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260899840 00000100:00100000:0.0:1784403496.757102:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784403496.757111:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+18:14794:x1871082260899840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784403496.757124:0:14789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403496.757139:0:14789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce4000/0x6828175665afbb26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6828175665afbb1f expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403496.757163:0:14789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce4000/0x6828175665afbb26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6828175665afbb1f expref: 19 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403496.757172:0:14789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce4000/0x6828175665afbb26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6828175665afbb1f expref: 19 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403496.757182:0:14789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4000, rc 0) 00000100:00100000:0.0:1784403496.757254:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001064a9-3cb5-489b-ba0a-bb457082004b+19:14794:x1871082260899840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403496.757260:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784403496.757419:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403496.757436:0:14794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2c00/0x6828175665afbb1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afbb26 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403496.757447:0:14794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2c00/0x6828175665afbb1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6828175665afbb26 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403496.757513:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403496.757542:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403496.757578:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a50321e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784403496.757633:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260899968 00000100:00100000:0.0:1784403496.757638:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260899968 00000100:00100000:0.0:1784403496.757671:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784403496.757687:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+19:14794:x1871082260899968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403496.758018:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+19:14794:x1871082260899968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403496.758025:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784403496.758107:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260899968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784403496.758152:0:14794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260900096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403496.758207:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403496.758233:0:14794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a50321e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784403496.758267:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260900096 00000100:00100000:2.0:1784403496.758272:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260900096 00000100:00100000:2.0:1784403496.758307:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784403496.758314:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+19:14794:x1871082260900096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784403496.758687:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+19:14794:x1871082260900096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 365us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403496.758695:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784403496.758977:0:14794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a73607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:001064a9-3cb5-489b-ba0a-bb457082004b:14794:1871082260900096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784403496.760592:0:16859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1784403496.760713:0:14794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1784403496.760742:0:14794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784403496.760753:0:14794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2c00/0x6828175665afbb1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afbb26 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403496.760765:0:14794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8c8a7b5b2c00/0x6828175665afbb1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6828175665afbb26 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403497.275206:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403497.275306:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240982528 00000100:00100000:1.0:1784403497.275317:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240982528 00000100:00100000:1.0:1784403497.275376:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:1.0:1784403497.275387:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+11:13749:x1871082240982528:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784403497.275404:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403497.275423:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a734a1800/0x6828175665afbb2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef57 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403497.275454:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a734a1800/0x6828175665afbb2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef57 expref: 12 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403497.275478:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a734a1800/0x6828175665afbb2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef57 expref: 12 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403497.275489:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1800, rc 0) 00000100:00100000:1.0:1784403497.275542:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+12:13749:x1871082240982528:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 157us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403497.275561:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:3.0:1784403497.282372:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403497.282500:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240982656 00000100:00100000:0.0:1784403497.282511:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240982656 00000100:00100000:0.0:1784403497.282573:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:0.0:1784403497.282583:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+12:13749:x1871082240982656:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784403497.282926:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+12:13749:x1871082240982656:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 343us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403497.282935:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:2.0:1784403497.296524:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403497.297090:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240982784 00000100:00100000:0.0:1784403497.297101:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240982784 00000100:00100000:0.0:1784403497.297162:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:0.0:1784403497.297173:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+12:13749:x1871082240982784:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784403497.297414:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+12:13749:x1871082240982784:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 243us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403497.297421:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:0.0:1784403497.308989:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403497.316389:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240982912 00000100:00100000:3.0:1784403497.316404:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240982912 00000100:00100000:3.0:1784403497.316536:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:3.0:1784403497.316547:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a49ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+12:13749:x1871082240982912:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784403497.316567:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403497.316588:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c8a7fce6200/0x6828175665afbb34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef5e expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403497.316620:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c8a7fce6200/0x6828175665afbb34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef5e expref: 13 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403497.316631:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c8a7fce6200/0x6828175665afbb34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef5e expref: 13 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403497.316641:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce6200, rc 0) 00000100:00100000:3.0:1784403497.316776:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a49ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+13:13749:x1871082240982912:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 230us (7797us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403497.316783:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:3.0:1784403497.332141:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403497.332277:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240983040 00000100:00100000:1.0:1784403497.332297:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240983040 00000100:00100000:1.0:1784403497.332649:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:1.0:1784403497.332658:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+13:13749:x1871082240983040:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784403497.332968:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+13:13749:x1871082240983040:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 309us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403497.332975:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:1.0:1784403497.340939:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403497.341151:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240983168 00000100:00100000:3.0:1784403497.341161:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240983168 00000100:00100000:3.0:1784403497.341220:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:3.0:1784403497.341231:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+13:13749:x1871082240983168:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784403497.341474:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c12d25a6-6fec-420f-abaf-beb60f397179+13:13749:x1871082240983168:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 244us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403497.341482:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:2.0:1784403497.697926:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260900224:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698000:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403497.698049:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260900736:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698077:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403497.698103:0:3567:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784403497.698121:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260900352:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698147:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403497.698164:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260900864:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698185:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403497.698212:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260900480:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698234:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403497.698251:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784403497.698257:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260900608:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698279:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403497.698312:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260900224 00000100:00100000:2.0:1784403497.698319:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260900224 00000100:00100000:2.0:1784403497.698366:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784403497.698375:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+19:3567:x1871082260900224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698419:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001064a9-3cb5-489b-ba0a-bb457082004b+19:3567:x1871082260900224:12345-0@lo:400:kworker.0 Request processed in 45us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403497.698426:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784403497.698455:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260900736 00000100:00100000:2.0:1784403497.698458:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260900736 00000100:00100000:2.0:1784403497.698498:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260900864 00000100:00100000:2.0:1784403497.698501:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260900864 00000100:00100000:2.0:1784403497.698512:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260900608 00000100:00100000:2.0:1784403497.698514:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260900608 00000100:00100000:2.0:1784403497.698526:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784403497.698532:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260900736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698561:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3567:x1871082260900736:12345-0@lo:400:kworker.0 Request processed in 30us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403497.698567:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784403497.698585:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784403497.698591:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260900864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698617:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3567:x1871082260900864:12345-0@lo:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403497.698623:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784403497.698633:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784403497.698638:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260900608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698682:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3565:x1871082260900608:12345-0@lo:400:kworker.0 Request processed in 44us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403497.698689:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784403497.698708:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260900352 00000100:00100000:2.0:1784403497.698712:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260900352 00000100:00100000:2.0:1784403497.698739:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260900480 00000100:00100000:2.0:1784403497.698742:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260900480 00000100:00100000:2.0:1784403497.698759:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784403497.698765:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260900352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698795:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260900352:12345-0@lo:400:kworker.0 Request processed in 30us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403497.698801:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784403497.698812:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784403497.698817:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260900480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698842:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260900480:12345-0@lo:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403497.698847:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1784403497.698901:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784403497.698905:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784403497.698908:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784403497.698954:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3565:1871082260900608:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698966:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260900480:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.698996:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260900352:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.699004:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3567:1871082260900864:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.699011:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:001064a9-3cb5-489b-ba0a-bb457082004b:3567:1871082260900224:0@lo:400:kworker.0 00000100:00100000:2.0:1784403497.699020:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3567:1871082260900736:0@lo:400:kworker.0 00010000:00010000:3.0:1784403497.703455:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403497.703913:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784403497.703939:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7ae7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260900992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784403497.704013:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403497.704066:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260900992 00000100:00100000:1.0:1784403497.704072:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260900992 00000100:00100000:1.0:1784403497.704133:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784403497.704143:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260900992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784403497.704182:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784403497.704228:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260900992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403497.704235:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784403497.704293:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7ae7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260900992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784403498.722080:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403499.067026:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.067079:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.067117:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403499.067163:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240983680 00000100:00100000:0.0:1784403499.067164:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403499.067178:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240983680 00000100:00100000:0.0:1784403499.067197:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.067226:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.067253:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403499.067263:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240983936 00000100:00100000:1.0:1784403499.067277:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240983936 00000100:00100000:0.0:1784403499.067311:0:15431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240983552 00000100:00100000:1.0:1784403499.067315:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240984064 00000100:00100000:0.0:1784403499.067317:0:15431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240983552 00000100:00100000:1.0:1784403499.067320:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240984064 00000100:00100000:1.0:1784403499.067358:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:1.0:1784403499.067469:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9791971e-5366-412b-99ee-4875c7fc85e0+5:2359:x1871082240983680:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403499.067488:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240983424 00000100:00100000:2.0:1784403499.067493:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240983424 00000100:00100000:2.0:1784403499.067526:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240983808 00000100:00100000:2.0:1784403499.067529:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240983808 00000100:00100000:2.0:1784403499.067549:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:2.0:1784403499.067556:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+6:2359:x1871082240983424:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403499.067569:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9791971e-5366-412b-99ee-4875c7fc85e0+5:2359:x1871082240983680:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 202us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403499.067587:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+6:2359:x1871082240983424:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 32us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403499.067594:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:2.0:1784403499.067614:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:2.0:1784403499.067621:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+6:2359:x1871082240983808:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1784403499.067658:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+6:2359:x1871082240983808:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 37us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403499.067665:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:0.0:1784403499.067899:0:15431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1784403499.067910:0:15431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2359:x1871082240983936:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403499.067957:0:15431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2359:x1871082240983936:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 50us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403499.067963:0:15431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1784403499.067979:0:15431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:0.0:1784403499.068171:0:15431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9791971e-5366-412b-99ee-4875c7fc85e0+5:2359:x1871082240983552:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403499.068201:0:15431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9791971e-5366-412b-99ee-4875c7fc85e0+5:2359:x1871082240983552:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 33us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403499.068208:0:15431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:0.0:1784403499.068224:0:15431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:0.0:1784403499.068231:0:15431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2359:x1871082240984064:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403499.068255:0:15431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2359:x1871082240984064:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403499.068262:0:15431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00080000:0.0:1784403499.069139:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784403499.069147:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784403499.069149:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784403499.069173:0:14789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240983296 00000100:00100000:0.0:1784403499.069184:0:14789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240983296 00000100:00100000:0.0:1784403499.069234:0:14789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:0.0:1784403499.069243:0:14789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+13:2359:x1871082240983296:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1784403499.069294:0:14789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c12d25a6-6fec-420f-abaf-beb60f397179+13:2359:x1871082240983296:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 52us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403499.069319:0:14789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:1.0:1784403499.070380:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:0.0:1784403499.191838:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.194148:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240984192 00000100:00100000:2.0:1784403499.194171:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240984192 00000100:00100000:2.0:1784403499.194287:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:2.0:1784403499.194301:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+6:14407:x1871082240984192:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784403499.194352:0:14797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403499.194380:0:14797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef65 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.194470:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.194489:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.194502:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.194520:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.194528:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.194535:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.202571:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3600/0x6828175665afbb50 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.202816:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3600/0x6828175665afbb50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.202832:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3600/0x6828175665afbb50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403499.203399:0:14797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784403499.203411:0:14797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403499.203516:0:14797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3600/0x6828175665afbb50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203533:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203540:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203547:0:14797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203554:0:14797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.203559:0:14797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203567:0:14797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203582:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a58960b00) 00010000:00010000:2.0:1784403499.203733:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.203739:0:14797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203747:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203764:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203769:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203786:0:14797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203792:0:14797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.203795:0:14797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203802:0:14797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203812:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c8a58960100) 00010000:00010000:2.0:1784403499.203814:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.203817:0:14797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.203823:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.204152:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef65 expref: 8 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.204171:0:14797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3600/0x6828175665afbb50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef65 expref: 7 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.204179:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c8a58960e00) 00010000:00010000:2.0:1784403499.204182:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784403499.204186:0:14797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3600, rc 0) 00000100:00100000:2.0:1784403499.204413:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+7:14407:x1871082240984192:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 10113us (12587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403499.204432:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:1.0:1784403499.225826:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.228698:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240984448 00000100:00100000:2.0:1784403499.228723:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240984448 00000100:00100000:2.0:1784403499.228828:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:2.0:1784403499.229008:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+7:14407:x1871082240984448:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784403499.229041:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403499.229069:0:14796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef6c expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.229176:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb5e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.230096:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb5e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.230121:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb5e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.230147:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb65 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.230155:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.230162:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.232344:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afbb6c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.232384:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afbb6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.232397:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afbb6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403499.232414:0:14796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1784403499.232753:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb5e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.232763:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb5e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.232771:0:14796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb5e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.232778:0:14796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.232784:0:14796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb5e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.232793:0:14796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb5e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.232808:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c8a58960e00) 00010000:00010000:2.0:1784403499.232811:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.232817:0:14796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb5e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.232823:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb5e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.232851:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.233640:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb65 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.233659:0:14796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb65 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.233665:0:14796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.233669:0:14796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb65 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.233679:0:14796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb65 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.233692:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c8a58960100) 00010000:00010000:2.0:1784403499.233695:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.233699:0:14796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb65 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.233706:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb65 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.234346:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef6c expref: 10 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.234367:0:14796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3000/0x6828175665afbb6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef6c expref: 9 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.234375:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a58960d00) 00010000:00010000:2.0:1784403499.234377:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.234387:0:14796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3000, rc 0) 00000100:00100000:2.0:1784403499.236391:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+9:14407:x1871082240984448:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 7364us (10556us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784403499.236409:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1784403499.242274:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.242841:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240984576 00000100:00100000:2.0:1784403499.242857:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240984576 00000100:00100000:2.0:1784403499.242974:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1784403499.242992:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+9:14407:x1871082240984576:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784403499.243165:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+9:14407:x1871082240984576:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 Request processed in 178us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403499.243173:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:0.0:1784403499.283465:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.283654:0:16679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240984704 00000100:00100000:2.0:1784403499.283666:0:16679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240984704 00000100:00100000:2.0:1784403499.283734:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1784403499.283745:0:16679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9791971e-5366-412b-99ee-4875c7fc85e0+9:14413:x1871082240984704:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403499.283768:0:16679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403499.283791:0:16679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef73 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.283908:0:16679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.283922:0:16679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.283933:0:16679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.283946:0:16679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.283966:0:16679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.283972:0:16679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284241:0:16679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284248:0:16679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284255:0:16679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284262:0:16679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.284266:0:16679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284275:0:16679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284288:0:16679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a58960b00) 00010000:00010000:2.0:1784403499.284291:0:16679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.284295:0:16679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284301:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbb81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284313:0:16679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284325:0:16679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284331:0:16679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284336:0:16679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.284340:0:16679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284346:0:16679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284354:0:16679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c8a58960100) 00010000:00010000:2.0:1784403499.284356:0:16679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.284359:0:16679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284365:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbb88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284398:0:16679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef73 expref: 10 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284666:0:16679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a58960b00) 00010000:00010000:2.0:1784403499.284670:0:16679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.284675:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef73 expref: 10 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.284698:0:16679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2800, rc 0) 00000100:00100000:0.0:1784403499.284836:0:16679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9791971e-5366-412b-99ee-4875c7fc85e0+9:14413:x1871082240984704:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1090us (1379us total) trans 0 rc 301/301 00000100:00100000:0.0:1784403499.286532:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:1.0:1784403499.289394:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.290030:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240984832 00000100:00100000:0.0:1784403499.290053:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240984832 00000100:00100000:0.0:1784403499.290115:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:0.0:1784403499.290126:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9791971e-5366-412b-99ee-4875c7fc85e0+9:14413:x1871082240984832:12345-192.168.204.28@tcp:700:lfs.0 00000100:00100000:0.0:1784403499.290225:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9791971e-5366-412b-99ee-4875c7fc85e0+9:14413:x1871082240984832:12345-192.168.204.28@tcp:700:lfs.0 Request processed in 101us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403499.290234:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:1.0:1784403499.292836:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.293032:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240985088 00000100:00100000:0.0:1784403499.293043:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240985088 00000100:00100000:0.0:1784403499.293131:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:0.0:1784403499.293142:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+9:14413:x1871082240985088:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1784403499.293206:0:14797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403499.293239:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbabd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eeee expref: 9 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.293262:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a58960b00) 00010000:00010000:0.0:1784403499.293267:0:14797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403499.293802:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.293825:0:14797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef50 expref: 5 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.293834:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.293977:0:14797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef50 expref: 5 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.293994:0:14797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef50 expref: 5 pid: 14798 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403499.294012:0:14797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14797:1871082260901120:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403499.294205:0:14797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a52271840 going to sleep for 11 seconds 00000100:00100000:0.0:1784403499.299411:0:14797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14797:1871082260901120:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403499.299457:0:14797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403499.301362:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.301589:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240985216 00000100:00100000:0.0:1784403499.301599:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240985216 00010000:00010000:0.0:1784403499.301656:0:14784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef50 expref: 6 pid: 14798 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403499.301696:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:0.0:1784403499.301706:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+6:2360:x1871082240985216:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403499.301723:0:14784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403499.301746:0:14784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef50 expref: 6 pid: 14798 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.301761:0:14784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef50 expref: 6 pid: 14798 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.301786:0:14784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbaf5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef50 expref: 6 pid: 14798 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.301803:0:14784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a58960b00) 00010000:00010000:0.0:1784403499.301820:0:14784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.301831:0:14784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.301839:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.302231:0:14784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403499.302288:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2360:x1871082240985216:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 582us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403499.302298:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00010000:00010000:2.0:1784403499.302357:0:14797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.302366:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.302393:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.302403:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.302423:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403499.305001:0:14797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784403499.305025:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.305037:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.305045:0:14797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.305051:0:14797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.305056:0:14797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.305063:0:14797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.305090:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a58960b00) 00010000:00010000:2.0:1784403499.305093:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.305098:0:14797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.305104:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbb8f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403499.305126:0:14797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c8f5de67 reply state 00000000df7529a9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403499.305134:0:14797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784403499.305247:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+10:14413:x1871082240985088:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 12103us (12416us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1784403499.305257:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00010000:00010000:3.0:1784403499.307439:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.307463:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.307471:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.307477:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403499.307481:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.307489:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.307506:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c8a58960100) 00010000:00010000:3.0:1784403499.307521:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403499.307526:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.307533:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbb96 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403499.413780:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.414154:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240985344 00000100:00100000:0.0:1784403499.414163:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240985344 00000100:00100000:0.0:1784403499.414282:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:0.0:1784403499.414292:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+9:14421:x1871082240985344:12345-192.168.204.28@tcp:101:lctl.0 00010000:00010000:0.0:1784403499.414318:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403499.414355:0:14796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbb9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef7a expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.414448:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afbba4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.414464:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afbba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.414638:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afbba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403499.414710:0:14796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784403499.414714:0:14796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403499.414760:0:14796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afbba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.414788:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbb9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef7a expref: 11 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.414922:0:14796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5600/0x6828175665afbba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef7a expref: 10 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.414931:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884d800) 00010000:00010000:0.0:1784403499.414934:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403499.414937:0:14796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5600, rc 0) 00000100:00100000:0.0:1784403499.415003:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+10:14421:x1871082240985344:12345-192.168.204.28@tcp:101:lctl.0 Request processed in 712us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403499.415010:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:1.0:1784403499.443096:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.443213:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240985472 00000100:00100000:2.0:1784403499.443225:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240985472 00000100:00100000:2.0:1784403499.443293:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:2.0:1784403499.443303:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+5:14422:x1871082240985472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403499.443324:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403499.443345:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbbab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef81 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.443407:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbbb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.443423:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.443457:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403499.443528:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784403499.443533:0:14798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403499.443558:0:14798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.443583:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbbab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef81 expref: 7 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.443604:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3a00/0x6828175665afbbb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef81 expref: 6 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.443613:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884d800) 00010000:00010000:2.0:1784403499.443616:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784403499.443620:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3a00, rc 0) 00000100:00100000:2.0:1784403499.443696:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+6:14422:x1871082240985472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 394us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403499.443704:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:3.0:1784403499.452389:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.452706:0:16679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240985600 00000100:00100000:2.0:1784403499.452721:0:16679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240985600 00000100:00100000:2.0:1784403499.452777:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:2.0:1784403499.452786:0:16679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6f18205-6d4d-463b-9cd7-d615580287c7+6:14422:x1871082240985600:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403499.452810:0:16679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403499.452834:0:16679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbbb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef88 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453265:0:16679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453281:0:16679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453292:0:16679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453306:0:16679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453313:0:16679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453333:0:16679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453480:0:16679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbbce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453489:0:16679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbbce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453496:0:16679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbbce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403499.453535:0:16679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784403499.453539:0:16679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403499.453564:0:16679:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbbce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453587:0:16679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453593:0:16679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453599:0:16679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453604:0:16679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.453608:0:16679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453615:0:16679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453637:0:16679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884d800) 00010000:00010000:2.0:1784403499.453642:0:16679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.453647:0:16679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453653:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453666:0:16679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453673:0:16679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453678:0:16679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453691:0:16679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.453695:0:16679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453701:0:16679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453709:0:16679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c8a58960b00) 00010000:00010000:2.0:1784403499.453711:0:16679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.453714:0:16679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453721:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453754:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbbb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef88 expref: 8 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453769:0:16679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbbce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef88 expref: 7 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.453776:0:16679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c8a58960f00) 00010000:00010000:2.0:1784403499.453778:0:16679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784403499.453781:0:16679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2800, rc 0) 00000100:00100000:2.0:1784403499.453851:0:16679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6f18205-6d4d-463b-9cd7-d615580287c7+7:14422:x1871082240985600:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1065us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403499.453859:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:1.0:1784403499.459388:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.459584:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240985856 00000100:00100000:2.0:1784403499.459609:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240985856 00000100:00100000:2.0:1784403499.459682:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:2.0:1784403499.459693:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+7:14422:x1871082240985856:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403499.459712:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403499.459734:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbbd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef8f expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403499.460110:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1784403499.460335:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbbd5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef8f expref: 9 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.460350:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884d800) 00010000:00010000:3.0:1784403499.460354:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403499.460359:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbbd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef8f expref: 9 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.460375:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3800, rc 0) 00000100:00100000:3.0:1784403499.460449:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6f18205-6d4d-463b-9cd7-d615580287c7+8:14422:x1871082240985856:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 757us (1070us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1784403499.460457:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1784403499.469714:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.470132:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240986112 00000100:00100000:0.0:1784403499.470143:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240986112 00000100:00100000:0.0:1784403499.470270:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:0.0:1784403499.470281:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+8:14422:x1871082240986112:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1784403499.470352:0:14796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403499.470381:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbbce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef88 expref: 8 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.470414:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c8a58960f00) 00010000:00010000:0.0:1784403499.470426:0:14796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403499.470451:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.470464:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.470475:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784403499.470712:0:14796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae41ec9e reply state 000000009c0f2594 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403499.470723:0:14796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784403499.470737:0:14796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1784403499.470829:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+9:14422:x1871082240986112:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 549us (1125us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784403499.470837:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00010000:00010000:3.0:1784403499.473863:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.473909:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.473918:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.473925:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403499.473936:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.473945:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.473962:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c8a4884d200) 00010000:00010000:3.0:1784403499.473965:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1784403499.473969:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.473975:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbbe3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403499.475327:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403499.475445:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240986368 00000100:00100000:3.0:1784403499.475455:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240986368 00000100:00100000:3.0:1784403499.475508:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:3.0:1784403499.475518:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+8:14422:x1871082240986368:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1784403499.475815:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+9:14422:x1871082240986368:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 297us (501us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1784403499.475823:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:0.0:1784403499.480408:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.480574:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240986624 00000100:00100000:2.0:1784403499.480583:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240986624 00000100:00100000:2.0:1784403499.480650:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:2.0:1784403499.480660:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+9:14422:x1871082240986624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403499.480688:0:14797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403499.480712:0:14797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef96 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.480789:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbbf1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.480806:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbbf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.480819:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbbf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.480836:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.480843:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.480912:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403499.481055:0:14797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784403499.481156:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbbf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481165:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbbf1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481173:0:14797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbbf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481180:0:14797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.481185:0:14797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbbf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481193:0:14797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbbf1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481206:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884d800) 00010000:00010000:2.0:1784403499.481209:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.481214:0:14797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbbf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481221:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbbf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481235:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481252:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481258:0:14797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481263:0:14797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.481267:0:14797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481273:0:14797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481281:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c8a58960b00) 00010000:00010000:2.0:1784403499.481284:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.481287:0:14797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbf8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481293:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbbf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481542:0:14797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef96 expref: 11 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481554:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884d800) 00010000:00010000:2.0:1784403499.481557:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784403499.481561:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbbea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef96 expref: 11 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.481583:0:14797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3200, rc 0) 00000100:00100000:2.0:1784403499.481754:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+10:14422:x1871082240986624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1094us (1356us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1784403499.481763:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:2.0:1784403499.486575:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.486696:0:16679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240986752 00000100:00100000:0.0:1784403499.486706:0:16679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240986752 00000100:00100000:0.0:1784403499.486795:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:0.0:1784403499.486805:0:16679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6f18205-6d4d-463b-9cd7-d615580287c7+10:14422:x1871082240986752:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403499.486847:0:16679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403499.486906:0:16679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afbc06 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890ef9d expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.487075:0:16679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.487090:0:16679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.487103:0:16679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403499.487159:0:16679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1784403499.487164:0:16679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784403499.487190:0:16679:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.487217:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4c00/0x6828175665afbc06 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef9d expref: 12 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.487237:0:16679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef9d expref: 11 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.487247:0:16679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c8a4884d500) 00010000:00010000:0.0:1784403499.487249:0:16679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784403499.487253:0:16679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4200, rc 0) 00000100:00100000:0.0:1784403499.487335:0:16679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6f18205-6d4d-463b-9cd7-d615580287c7+11:14422:x1871082240986752:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 529us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403499.487342:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:0.0:1784403499.491735:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403499.493155:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240986880 00000100:00100000:3.0:1784403499.493169:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240986880 00000100:00100000:3.0:1784403499.493295:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:3.0:1784403499.493307:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+11:14422:x1871082240986880:12345-192.168.204.28@tcp:37:lfs.0 00000100:00100000:2.0:1784403499.505966:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+11:14422:x1871082240986880:12345-192.168.204.28@tcp:37:lfs.0 Request processed in 12647us (14228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403499.505982:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:2.0:1784403499.515435:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403499.516528:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240987136 00000100:00100000:1.0:1784403499.516542:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240987136 00000100:00100000:1.0:1784403499.516610:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:1.0:1784403499.516621:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fe87850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+11:14422:x1871082240987136:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403499.516968:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fe87850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+12:14422:x1871082240987136:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 347us (1541us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1784403499.516976:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:0.0:1784403499.593268:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403499.593651:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240987264 00000100:00100000:3.0:1784403499.593663:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240987264 00000100:00100000:3.0:1784403499.593722:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:3.0:1784403499.593731:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+10:14428:x1871082240987264:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403499.593765:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403499.593791:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afbc14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efa4 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.593859:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbc1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.593913:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbc1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.593924:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbc1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.593941:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbc22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.593948:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbc22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.593955:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbc22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594079:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7200/0x6828175665afbc29 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594086:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7200/0x6828175665afbc29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594093:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7200/0x6828175665afbc29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403499.594126:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1784403499.594137:0:14798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784403499.594182:0:14798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7200/0x6828175665afbc29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594196:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbc1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594203:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbc1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594211:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbc1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594217:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403499.594221:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbc1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594228:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbc1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594241:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884d800) 00010000:00010000:3.0:1784403499.594243:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403499.594248:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbc1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594254:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbc1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594269:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbc22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594276:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbc22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594293:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbc22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594299:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403499.594302:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbc22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594309:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbc22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594317:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c8a43245c00) 00010000:00010000:3.0:1784403499.594319:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403499.594322:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbc22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594328:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbc22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594361:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afbc14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efa4 expref: 12 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594374:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7200/0x6828175665afbc29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efa4 expref: 11 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.594382:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c8a4884d500) 00010000:00010000:3.0:1784403499.594384:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784403499.594387:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7200, rc 0) 00000100:00100000:3.0:1784403499.596656:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+11:14428:x1871082240987264:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2911us (3382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403499.596690:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:3.0:1784403499.605797:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.605914:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240987520 00000100:00100000:2.0:1784403499.605925:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240987520 00000100:00100000:2.0:1784403499.605990:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:2.0:1784403499.606001:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+11:14428:x1871082240987520:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1784403499.606022:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403499.606047:0:14796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc30 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efab expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.606178:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.606193:0:14796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef9d expref: 11 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.606203:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.606260:0:14796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef9d expref: 11 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.606276:0:14796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef9d expref: 11 pid: 16679 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403499.606293:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e15500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14796:1871082260901248:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403499.606413:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a52206c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403499.608988:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.609194:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e15500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14796:1871082260901248:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403499.609226:0:14796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403499.609356:0:14782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240987648 00000100:00100000:3.0:1784403499.609364:0:14782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240987648 00010000:00010000:3.0:1784403499.609400:0:14782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef9d expref: 12 pid: 16679 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403499.609578:0:14782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1784403499.609589:0:14782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943275500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+12:2360:x1871082240987648:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403499.609606:0:14782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403499.609612:0:14782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef9d expref: 12 pid: 16679 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.609633:0:14782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef9d expref: 12 pid: 16679 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.609659:0:14782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4200/0x6828175665afbc0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890ef9d expref: 12 pid: 16679 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.609675:0:14782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c8a4884d500) 00010000:00010000:3.0:1784403499.609679:0:14782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.609690:0:14782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.609696:0:14782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.609742:0:14782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403499.609803:0:14782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943275500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f18205-6d4d-463b-9cd7-d615580287c7+11:2360:x1871082240987648:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 215us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403499.609811:0:14782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00010000:00010000:2.0:1784403499.610017:0:14796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.610024:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.610043:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.610050:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.610055:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611191:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611211:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611221:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403499.611235:0:14796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784403499.611263:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611271:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611278:0:14796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611285:0:14796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.611289:0:14796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611297:0:14796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611307:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c8a4884d500) 00010000:00010000:2.0:1784403499.611310:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403499.611314:0:14796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611321:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc37 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784403499.611335:0:14796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000090d9a60d reply state 00000000e7796690 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403499.611352:0:14796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784403499.611390:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc30 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efab expref: 14 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611417:0:14796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efab expref: 13 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.611425:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:2.0:1784403499.611427:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1784403499.611429:0:14796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3800, rc 0) 00000100:00100000:2.0:1784403499.611634:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+14:14428:x1871082240987520:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5626us (5838us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784403499.611643:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00010000:00010000:3.0:1784403499.617603:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.617622:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.617639:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.617646:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403499.617651:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.617660:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.617680:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c8a58960b00) 00010000:00010000:3.0:1784403499.617683:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403499.617689:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.617696:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc3e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403499.623572:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403499.623803:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240987776 00000100:00100000:3.0:1784403499.623815:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240987776 00000100:00100000:3.0:1784403499.623978:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:3.0:1784403499.623989:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+13:14428:x1871082240987776:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1784403499.624014:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403499.624039:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afbc53 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efb2 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.624351:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.624367:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.624378:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403499.624429:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784403499.624433:0:14798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403499.624453:0:14798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.624463:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.624829:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7400/0x6828175665afbc53 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb2 expref: 15 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.624845:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb2 expref: 14 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.624854:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:2.0:1784403499.624857:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784403499.624861:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2a00, rc 0) 00000100:00100000:2.0:1784403499.625036:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+14:14428:x1871082240987776:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1047us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403499.625139:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:1.0:1784403499.630828:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.631180:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240988032 00000100:00100000:2.0:1784403499.631189:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240988032 00000100:00100000:1.0:1784403499.631306:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:1.0:1784403499.631319:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9791971e-5366-412b-99ee-4875c7fc85e0+14:14428:x1871082240988032:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1784403499.631712:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9791971e-5366-412b-99ee-4875c7fc85e0+15:14428:x1871082240988032:12345-192.168.204.28@tcp:35:bash.0 Request processed in 394us (891us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1784403499.631720:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:3.0:1784403499.742494:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.742644:0:16679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240988288 00000100:00100000:0.0:1784403499.742654:0:16679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240988288 00000100:00100000:0.0:1784403499.742716:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:0.0:1784403499.742727:0:16679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a73604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9791971e-5366-412b-99ee-4875c7fc85e0+15:14438:x1871082240988288:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1784403499.742765:0:16679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403499.742788:0:16679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbc61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efb9 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403499.742963:0:16679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784403499.743084:0:16679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbc61 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb9 expref: 17 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.743102:0:16679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c8a4884d800) 00010000:00010000:0.0:1784403499.743105:0:16679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784403499.743111:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbc61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb9 expref: 17 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403499.743127:0:16679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5c00, rc 0) 00000100:00100000:0.0:1784403499.743200:0:16679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a73604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9791971e-5366-412b-99ee-4875c7fc85e0+16:14438:x1871082240988288:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 474us (714us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1784403499.743208:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00010000:00010000:2.0:1784403499.743661:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403499.747960:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.748506:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240988544 00000100:00100000:2.0:1784403499.748518:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240988544 00000100:00100000:2.0:1784403499.748575:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:2.0:1784403499.748586:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9791971e-5366-412b-99ee-4875c7fc85e0+16:14438:x1871082240988544:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1784403499.748894:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9791971e-5366-412b-99ee-4875c7fc85e0+17:14438:x1871082240988544:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 308us (942us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784403499.748903:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:1.0:1784403499.791383:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403499.791508:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240988800 00000100:00100000:2.0:1784403499.791520:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240988800 00000100:00100000:2.0:1784403499.791597:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:2.0:1784403499.791607:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+17:14441:x1871082240988800:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1784403499.791662:0:14797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403499.791686:0:14797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc6f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efc0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.791822:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc76 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.791847:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.791861:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403499.791914:0:14797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784403499.792286:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbc6f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efc0 expref: 20 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.792310:0:14797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efc0 expref: 19 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.792319:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:3.0:1784403499.792322:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784403499.792326:0:14797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2800, rc 0) 00000100:00100000:3.0:1784403499.792404:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+19:14441:x1871082240988800:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 789us (1023us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1784403499.792412:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:0.0:1784403499.808017:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403499.808131:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403499.809030:0:14783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240989056 00000100:00100000:3.0:1784403499.809044:0:14783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240989056 00000100:00100000:3.0:1784403499.809128:0:14783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:3.0:1784403499.809139:0:14783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9791971e-5366-412b-99ee-4875c7fc85e0+19:2359:x1871082240989056:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403499.809159:0:14783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403499.809189:0:14783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbc76 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efc0 expref: 19 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403499.809234:0:14783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:3.0:1784403499.809240:0:14783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403499.809328:0:14783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9791971e-5366-412b-99ee-4875c7fc85e0+18:2359:x1871082240989056:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 190us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403499.809336:0:14783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:2.0:1784403499.811590:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240988928 00000100:00100000:2.0:1784403499.811609:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240988928 00000100:00100000:2.0:1784403499.811728:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:2.0:1784403499.811738:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+18:14441:x1871082240988928:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:2.0:1784403499.811820:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbc84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.811838:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbc84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.811852:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbc84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.811895:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbc84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.811903:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbc84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.811926:0:14796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbc84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.811932:0:14796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3200 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403499.811936:0:14796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbc84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.811945:0:14796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbc84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.811959:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:2.0:1784403499.811963:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784403499.811968:0:14796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbc84 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403499.811974:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3200/0x6828175665afbc84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403499.812087:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+18:14441:x1871082240988928:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 349us (4080us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403499.812096:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:0.0:1784403499.815557:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403499.818279:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240989312 00000100:00100000:1.0:1784403499.818298:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240989312 00000100:00100000:1.0:1784403499.818425:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:1.0:1784403499.818437:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9791971e-5366-412b-99ee-4875c7fc85e0+18:14441:x1871082240989312:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1784403499.818746:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9791971e-5366-412b-99ee-4875c7fc85e0+19:14441:x1871082240989312:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 311us (3198us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1784403499.818755:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000040:00080000:1.0:1784403500.191622:0:14830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784403500.236982:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403500.237053:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240989568 00000100:00100000:0.0:1784403500.237064:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240989568 00000100:00100000:0.0:1784403500.237156:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:0.0:1784403500.237167:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7af40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+19:14473:x1871082240989568:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:0.0:1784403500.237196:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403500.237221:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbc8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efc7 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.237339:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbc92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.237355:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbc92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.237366:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbc92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784403500.237376:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784403500.237544:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbc8b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efc7 expref: 22 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.237564:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbc92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efc7 expref: 21 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.237573:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:0.0:1784403500.237576:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403500.237580:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4a00, rc 0) 00000100:00100000:0.0:1784403500.237662:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7af40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+21:14473:x1871082240989568:12345-192.168.204.28@tcp:101:cat.0 Request processed in 496us (691us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1784403500.237671:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:1.0:1784403500.247312:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403500.247367:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403500.247474:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240989952 00000100:00100000:0.0:1784403500.247498:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240989952 00000100:00100000:0.0:1784403500.247564:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:0.0:1784403500.247575:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9791971e-5366-412b-99ee-4875c7fc85e0+21:14473:x1871082240989952:12345-192.168.204.28@tcp:35:cat.0 00000100:00100000:0.0:1784403500.247973:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9791971e-5366-412b-99ee-4875c7fc85e0+22:14473:x1871082240989952:12345-192.168.204.28@tcp:35:cat.0 Request processed in 398us (603us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1784403500.247980:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:2.0:1784403500.248410:0:14782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240989696 00000100:00100000:2.0:1784403500.248417:0:14782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240989696 00000100:00100000:2.0:1784403500.248472:0:14782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:2.0:1784403500.248480:0:14782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9791971e-5366-412b-99ee-4875c7fc85e0+22:2358:x1871082240989696:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403500.248494:0:14782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403500.248520:0:14782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbc92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efc7 expref: 22 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403500.248551:0:14782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:2.0:1784403500.248557:0:14782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403500.248590:0:14782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9791971e-5366-412b-99ee-4875c7fc85e0+21:2358:x1871082240989696:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 110us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403500.248597:0:14782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:1.0:1784403500.322436:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403500.322553:0:16679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240990208 00000100:00100000:0.0:1784403500.322564:0:16679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240990208 00000100:00100000:0.0:1784403500.322638:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:0.0:1784403500.322650:0:16679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7744b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9791971e-5366-412b-99ee-4875c7fc85e0+21:14479:x1871082240990208:12345-192.168.204.28@tcp:101:dd.0 00010000:00010000:0.0:1784403500.322680:0:16679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784403500.322714:0:16679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbca0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efce expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.323095:0:16679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.323114:0:16679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efab expref: 22 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.323123:0:16679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb2 expref: 22 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.323131:0:16679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.323167:0:16679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb2 expref: 22 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.323201:0:16679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb2 expref: 22 pid: 14798 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403500.323215:0:16679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16679:1871082260901376:192.168.204.28@tcp:104: 00010000:00010000:0.0:1784403500.323443:0:16679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efab expref: 22 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.323453:0:16679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efab expref: 22 pid: 14796 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403500.323462:0:16679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16679:1871082260901504:192.168.204.28@tcp:104: 00000100:00100000:0.0:1784403500.323488:0:16679:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fd180 going to sleep for 11 seconds 00000100:00100000:2.0:1784403500.339566:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403500.339621:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403500.339777:0:14782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240990336 00000100:00100000:3.0:1784403500.339796:0:14782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240990336 00010000:00010000:3.0:1784403500.339842:0:14782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb2 expref: 23 pid: 14798 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403500.339863:0:16679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16679:1871082260901376:192.168.204.28@tcp:104: 00000100:00100000:3.0:1784403500.339909:0:14782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240990464 00000100:00100000:3.0:1784403500.339914:0:14782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240990464 00000100:00100000:0.0:1784403500.339918:0:16679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16679:1871082260901504:192.168.204.28@tcp:104: 00010000:00010000:3.0:1784403500.339934:0:14782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efab expref: 24 pid: 14796 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403500.339948:0:16679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403500.339955:0:14782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:3.0:1784403500.339969:0:14782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9791971e-5366-412b-99ee-4875c7fc85e0+24:2360:x1871082240990336:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403500.339987:0:14782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403500.339995:0:14782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb2 expref: 24 pid: 14798 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340008:0:14782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb2 expref: 24 pid: 14798 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340032:0:14782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbc5a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efb2 expref: 24 pid: 14798 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340070:0:14782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:3.0:1784403500.340076:0:14782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340084:0:14782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340090:0:14782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403500.340156:0:14782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9791971e-5366-412b-99ee-4875c7fc85e0+23:2360:x1871082240990336:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 189us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403500.340164:0:14782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:3.0:1784403500.340214:0:14782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:3.0:1784403500.340222:0:14782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9791971e-5366-412b-99ee-4875c7fc85e0+22:2360:x1871082240990464:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784403500.340230:0:14782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403500.340236:0:14782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efab expref: 22 pid: 14796 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340245:0:14782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efab expref: 22 pid: 14796 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340258:0:14782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbc45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efab expref: 22 pid: 14796 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340269:0:14782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:3.0:1784403500.340273:0:14782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340291:0:14782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340299:0:14782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340323:0:14782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403500.340344:0:14782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9791971e-5366-412b-99ee-4875c7fc85e0+21:2360:x1871082240990464:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 123us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403500.340351:0:14782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00010000:00010000:3.0:1784403500.340370:0:16679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340377:0:16679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403500.340396:0:16679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784403500.340582:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbca0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efce expref: 22 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340601:0:16679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5e00/0x6828175665afbca7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efce expref: 21 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.340620:0:16679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:3.0:1784403500.340623:0:16679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784403500.340626:0:16679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce5e00, rc 0) 00000100:00100000:3.0:1784403500.340654:0:16679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7744b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9791971e-5366-412b-99ee-4875c7fc85e0+21:14479:x1871082240990208:12345-192.168.204.28@tcp:101:dd.0 Request processed in 18006us (18229us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1784403500.340670:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:1.0:1784403500.348078:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403500.348172:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240990720 00000100:00100000:3.0:1784403500.348184:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240990720 00000100:00100000:3.0:1784403500.348250:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:3.0:1784403500.348261:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+21:14479:x1871082240990720:12345-192.168.204.28@tcp:36:dd.0 00010000:00010000:3.0:1784403500.348714:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.348733:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.348745:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784403500.348998:0:14797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1784403500.349042:0:14797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000532d75e0 reply state 000000000d6631ea transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403500.349052:0:14797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784403500.349197:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+24:14479:x1871082240990720:12345-192.168.204.28@tcp:36:dd.0 Request processed in 935us (1129us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1784403500.349205:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000020:00080000:3.0:1784403500.349211:0:14797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784403500.357422:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.357441:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.357450:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.357479:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403500.357484:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.357493:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.357512:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:3.0:1784403500.357515:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403500.357520:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.357528:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbcb5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403500.359929:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403500.360620:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240990848 00000100:00100000:2.0:1784403500.360634:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240990848 00000100:00100000:2.0:1784403500.360709:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:2.0:1784403500.360720:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+23:14479:x1871082240990848:12345-192.168.204.28@tcp:101:dd.0 00010000:00010000:2.0:1784403500.360767:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403500.360805:0:14796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efd5 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403500.360909:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efd5 expref: 24 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403500.360926:0:14796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efd5 expref: 24 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403500.360949:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:2.0:1784403500.360953:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784403500.360957:0:14796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2800, rc 0) 00000100:00100000:2.0:1784403500.361038:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+24:14479:x1871082240990848:12345-192.168.204.28@tcp:101:dd.0 Request processed in 319us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403500.361062:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:0.0:1784403500.387345:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403500.387539:0:14782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240991104 00000100:00100000:3.0:1784403500.387550:0:14782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240991104 00000100:00100000:3.0:1784403500.387632:0:14782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:3.0:1784403500.387643:0:14782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9791971e-5366-412b-99ee-4875c7fc85e0+24:14479:x1871082240991104:12345-192.168.204.28@tcp:103:dd.0 00010000:00010000:3.0:1784403500.387660:0:14782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784403500.387691:0:14782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efd5 expref: 24 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403500.387717:0:14782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:3.0:1784403500.387723:0:14782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784403500.387797:0:14782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9791971e-5366-412b-99ee-4875c7fc85e0+23:14479:x1871082240991104:12345-192.168.204.28@tcp:103:dd.0 Request processed in 155us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403500.387805:0:14782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:0.0:1784403500.390183:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403500.390358:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240991232 00000100:00100000:1.0:1784403500.390369:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240991232 00000100:00100000:1.0:1784403500.390445:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:1.0:1784403500.390623:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+23:14479:x1871082240991232:12345-192.168.204.28@tcp:58:dd.0 00010000:00010000:1.0:1784403500.390744:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403500.390782:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403500.391176:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784403500.395825:0:14798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784403500.396215:0:14798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1784403500.396299:0:14798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1784403500.396815:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+23:14479:x1871082240991232:12345-192.168.204.28@tcp:58:dd.0 Request processed in 6264us (6545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403500.396830:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:1.0:1784403500.401198:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403500.401475:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240991360 00000100:00100000:2.0:1784403500.401486:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240991360 00000100:00100000:2.0:1784403500.401556:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:2.0:1784403500.401567:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7744b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+23:14479:x1871082240991360:12345-192.168.204.28@tcp:101:dd.0 00010000:00010000:2.0:1784403500.401591:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403500.401625:0:14796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbcca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efdc expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403500.401689:0:14796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403500.401701:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbcca lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efdc expref: 24 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403500.401723:0:14796:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403500.401738:0:14796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbcca lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efdc expref: 24 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403500.401754:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:2.0:1784403500.401757:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784403500.401760:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbcca lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efdc expref: 24 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403500.401768:0:14796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b2e00, rc 0) 00000100:00100000:2.0:1784403500.401906:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7744b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+24:14479:x1871082240991360:12345-192.168.204.28@tcp:101:dd.0 Request processed in 340us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403500.401913:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00010000:00010000:3.0:1784403500.767180:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784403500.767614:0:3565:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784403500.767641:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260901632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784403500.767737:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403500.767889:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260901632 00000100:00100000:0.0:1784403500.767899:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260901632 00000100:00100000:0.0:1784403500.767975:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784403500.767987:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260901632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784403500.768029:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784403500.768103:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3565:x1871082260901632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403500.768111:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1784403500.768246:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403500.768303:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3565:1871082260901632:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1784403501.215530:0:14830:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784403501.215540:0:14830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784403501.215583:0:14830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1784403501.215591:0:14830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1784403501.215757:0:14830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77448a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14830:1871082260901760:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784403501.215917:0:14830:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a454ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1784403501.220174:0:14830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77448a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14830:1871082260901760:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784403501.220778:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403501.227950:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240991488 00000100:00100000:2.0:1784403501.227969:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240991488 00000100:00100000:2.0:1784403501.228093:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:2.0:1784403501.228121:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9791971e-5366-412b-99ee-4875c7fc85e0+24:14480:x1871082240991488:12345-192.168.204.28@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784403501.228238:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9791971e-5366-412b-99ee-4875c7fc85e0+24:14480:x1871082240991488:12345-192.168.204.28@tcp:900:lhsmtool_posix.0 Request processed in 133us (7462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403501.228248:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00080000:3.0:1784403501.228747:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784403501.243319:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403501.246081:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240991616 00000100:00100000:3.0:1784403501.246101:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240991616 00000100:00100000:3.0:1784403501.246343:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:3.0:1784403501.246357:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+24:14480:x1871082240991616:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784403501.246401:0:14797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784403501.246530:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+24:14480:x1871082240991616:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 176us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403501.246539:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:0.0:1784403501.254837:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403501.256529:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240991744 00000100:00100000:2.0:1784403501.256545:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240991744 00000100:00100000:2.0:1784403501.256633:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:2.0:1784403501.256645:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+24:14480:x1871082240991744:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784403501.256736:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcd1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.256755:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.256768:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.256841:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbcd8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.256850:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.256920:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.256947:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.256956:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.256962:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784403501.257004:0:14796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784403501.257009:0:14796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784403501.257825:0:14796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257846:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257852:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcd1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257859:0:14796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257889:0:14796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403501.257895:0:14796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257902:0:14796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcd1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257927:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a58960d00) 00010000:00010000:2.0:1784403501.257931:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403501.257936:0:14796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcd1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257943:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2800/0x6828175665afbcd1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257958:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257965:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbcd8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257970:0:14796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257975:0:14796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403501.257978:0:14796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257984:0:14796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbcd8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.257990:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8c8a58960b00) 00010000:00010000:2.0:1784403501.257992:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403501.257995:0:14796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbcd8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.258001:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbcd8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.258041:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.258047:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.258054:0:14796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.258060:0:14796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403501.258064:0:14796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.258072:0:14796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.258081:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:2.0:1784403501.258084:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784403501.258088:0:14796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.258094:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2a00/0x6828175665afbcdf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403501.258489:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+24:14480:x1871082240991744:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 Request processed in 1840us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403501.258499:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:0.0:1784403501.281477:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403501.293789:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240992000 00000100:00100000:3.0:1784403501.293811:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240992000 00000100:00100000:3.0:1784403501.293911:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:3.0:1784403501.293923:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+24:14480:x1871082240992000:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784403501.293946:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784403501.293969:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbce6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efe3 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.294086:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbced lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296424:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbced lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296460:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbced lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784403501.296503:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784403501.296710:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbced lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296719:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbced lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296726:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbced lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296733:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403501.296737:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbced lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296746:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbced lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296760:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:3.0:1784403501.296763:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784403501.296768:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbced lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296774:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7800/0x6828175665afbced lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296839:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbce6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efe3 expref: 26 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296850:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c8a58960d00) 00010000:00010000:3.0:1784403501.296853:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784403501.296890:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbce6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efe3 expref: 26 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.296903:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce7000, rc 0) 00000100:00100000:3.0:1784403501.296984:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+25:14480:x1871082240992000:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 3062us (15514us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1784403501.296994:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:3.0:1784403501.303565:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403501.303611:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240992128 00000100:00100000:2.0:1784403501.304728:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240992128 00000100:00100000:2.0:1784403501.304801:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:2.0:1784403501.304820:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+25:14480:x1871082240992128:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784403501.304880:0:14796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784403501.305004:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+25:14480:x1871082240992128:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 186us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403501.305013:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:0.0:1784403501.313785:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.313951:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240992384 00000100:00100000:1.0:1784403501.313964:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240992384 00000100:00100000:1.0:1784403501.314034:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:1.0:1784403501.314045:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+25:14480:x1871082240992384:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403501.314070:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403501.314098:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbcfb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efea expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784403501.318670:0:14798:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1784403501.318684:0:14798:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1784403501.318752:0:14798:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1784403501.320654:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbd02 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.320675:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbd02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.320688:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbd02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.321017:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbcfb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efea expref: 28 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.321040:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbd02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efea expref: 27 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.321050:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a4884d200) 00010000:00010000:0.0:1784403501.321052:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784403501.321056:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7fce4a00, rc 0) 00000100:00100000:0.0:1784403501.321146:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+27:14480:x1871082240992384:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 7101us (7370us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1784403501.321157:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:3.0:1784403501.334076:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403501.335244:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240992640 00000100:00100000:0.0:1784403501.335258:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240992640 00000100:00100000:0.0:1784403501.335331:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:0.0:1784403501.335340:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+27:14480:x1871082240992640:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784403501.335400:0:14796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403501.335430:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce4a00/0x6828175665afbd02 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efea expref: 27 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.335450:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a4884d200) 00010000:00010000:0.0:1784403501.335460:0:14796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784403501.335483:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbd10 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.335499:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbd10 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.335521:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbd10 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.335535:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbd17 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9bee69c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.335543:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbd17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9bee69c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.335549:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbd17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9bee69c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336214:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbd10 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336225:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbd10 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336233:0:14796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbd10 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336240:0:14796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403501.336244:0:14796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbd10 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336252:0:14796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbd10 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336262:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c8a4884d500) 00010000:00010000:0.0:1784403501.336264:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403501.336268:0:14796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbd10 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336274:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5c00/0x6828175665afbd10 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336283:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbd17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9bee69c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336289:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbd17 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9bee69c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336295:0:14796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbd17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9bee69c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336306:0:14796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403501.336309:0:14796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbd17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9bee69c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336315:0:14796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbd17 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9bee69c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336321:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9bee69c2 (ffff8c8a4884d600) 00010000:00010000:0.0:1784403501.336324:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403501.336326:0:14796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbd17 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9bee69c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.336332:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce5800/0x6828175665afbd17 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9bee69c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403501.336429:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+26:14480:x1871082240992640:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 1087us (2363us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784403501.336436:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:0.0:1784403501.346748:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.348511:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240992768 00000100:00100000:1.0:1784403501.348535:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240992768 00000100:00100000:1.0:1784403501.348620:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:1.0:1784403501.348632:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+26:14480:x1871082240992768:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403501.348654:0:14797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403501.348680:0:14797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd1e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eff1 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.348728:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afbd25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.348743:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afbd25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.348753:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afbd25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.348902:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd1e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff1 expref: 28 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.348921:0:14797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1400/0x6828175665afbd25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff1 expref: 27 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.348930:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a47dbda00) 00010000:00010000:1.0:1784403501.348933:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784403501.348937:0:14797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1400, rc 0) 00000100:00100000:1.0:1784403501.349019:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+27:14480:x1871082240992768:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 389us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403501.349034:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:3.0:1784403501.356073:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403501.359642:0:16679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240993024 00000100:00100000:2.0:1784403501.359659:0:16679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240993024 00000100:00100000:3.0:1784403501.361053:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:3.0:1784403501.361068:0:16679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9791971e-5366-412b-99ee-4875c7fc85e0+27:14480:x1871082240993024:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784403501.361167:0:16679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.361188:0:16679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.361203:0:16679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784403501.362165:0:16679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1784403501.362180:0:16679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 506930313078ns, next at 507930310385ns, rc = 0 00000004:00010000:1.0:1784403501.369151:0:16679:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e068939e reply state 0000000070b74df0 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403501.369172:0:16679:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784403501.369320:0:16679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9791971e-5366-412b-99ee-4875c7fc85e0+29:14480:x1871082240993024:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 8250us (13255us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1784403501.369333:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:0.0:1784403501.378107:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.379604:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240993152 00000100:00100000:1.0:1784403501.379621:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240993152 00000100:00100000:1.0:1784403501.379727:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:1.0:1784403501.379740:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+29:14480:x1871082240993152:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403501.379774:0:14797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403501.380147:0:14797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd33 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890eff8 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.380216:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff8 expref: 30 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.380231:0:14797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff8 expref: 30 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.380250:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a47dbda00) 00010000:00010000:1.0:1784403501.380253:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784403501.380257:0:14797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1600, rc 0) 00000100:00100000:1.0:1784403501.380318:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+30:14480:x1871082240993152:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 582us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403501.380343:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00010000:00010000:3.0:1784403501.381225:0:3552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.381242:0:3552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.381251:0:3552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.381269:0:3552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403501.381274:0:3552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.381282:0:3552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.381297:0:3552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a47dbda00) 00010000:00010000:3.0:1784403501.381300:0:3552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784403501.381304:0:3552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.381311:0:3552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd2c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403501.384340:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.385494:0:15431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240993280 00000100:00100000:1.0:1784403501.385522:0:15431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240993280 00000100:00100000:1.0:1784403501.385607:0:15431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:1.0:1784403501.385621:0:15431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9791971e-5366-412b-99ee-4875c7fc85e0+5:2360:x1871082240993280:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1784403501.385627:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784403501.386330:0:15431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9791971e-5366-412b-99ee-4875c7fc85e0+6:2360:x1871082240993280:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 708us (1996us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784403501.386339:0:15431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:3.0:1784403501.389983:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.390495:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240993536 00000100:00100000:1.0:1784403501.390630:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240993536 00000100:00100000:1.0:1784403501.390774:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:1.0:1784403501.390890:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9791971e-5366-412b-99ee-4875c7fc85e0+29:14480:x1871082240993536:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784403501.391158:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9791971e-5366-412b-99ee-4875c7fc85e0+30:14480:x1871082240993536:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 298us (1185us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1784403501.391166:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:3.0:1784403501.397036:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403501.397263:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240993792 00000100:00100000:2.0:1784403501.397274:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240993792 00000100:00100000:2.0:1784403501.397342:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:2.0:1784403501.397353:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+30:14480:x1871082240993792:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784403501.397492:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+30:14480:x1871082240993792:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 140us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403501.397501:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:0.0:1784403501.403056:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403501.403713:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240993920 00000100:00100000:2.0:1784403501.403725:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240993920 00000100:00100000:1.0:1784403501.403926:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:1.0:1784403501.403940:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+30:14480:x1871082240993920:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403501.403963:0:14797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403501.403989:0:14797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd3a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890efff expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.404065:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afbd41 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.404082:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afbd41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.404110:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afbd41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784403501.404147:0:14797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784403501.404169:0:14797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afbd41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.404198:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd3a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efff expref: 32 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.404341:0:14797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afbd41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efff expref: 31 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.404351:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a47dbda00) 00010000:00010000:1.0:1784403501.404354:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784403501.404358:0:14797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a0600, rc 0) 00000100:00100000:1.0:1784403501.405968:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+31:14480:x1871082240993920:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 2022us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403501.405981:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000001:00080000:3.0:1784403501.406272:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:3.0:1784403501.406290:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:3.0:1784403501.406327:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1784403501.406349:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000100:00100000:3.0:1784403501.410302:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.410532:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240994048 00000100:00100000:1.0:1784403501.410544:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240994048 00000100:00100000:1.0:1784403501.410612:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:1.0:1784403501.410624:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9791971e-5366-412b-99ee-4875c7fc85e0+6:2361:x1871082240994048:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784403501.410642:0:15429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784403501.410666:0:15429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afbd48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890f006 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784403501.410729:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bd62d, blocks: 0x1 00010000:00010000:1.0:1784403501.410750:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1784403501.410755:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403501.410765:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afbd48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f006 expref: 7 pid: 15429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.410799:0:15429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afbd48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f006 expref: 7 pid: 15429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.410814:0:15429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a734a1a00, rc 0) 00000100:00100000:1.0:1784403501.410933:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9791971e-5366-412b-99ee-4875c7fc85e0+7:2361:x1871082240994048:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 310us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403501.410940:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1784403501.421967:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403501.426995:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240994304 00000100:00100000:0.0:1784403501.427013:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240994304 00000100:00100000:0.0:1784403501.427138:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:0.0:1784403501.427151:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+18:14480:x1871082240994304:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784403501.427284:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9791971e-5366-412b-99ee-4875c7fc85e0+18:14480:x1871082240994304:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 135us (5329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403501.427309:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:0.0:1784403501.435768:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403501.439527:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240994432 00000100:00100000:2.0:1784403501.439546:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240994432 00000100:00100000:2.0:1784403501.439649:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:2.0:1784403501.439662:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+18:14480:x1871082240994432:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784403501.535816:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1784403501.535989:0:6314:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1784403501.535999:0:6314:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1784403501.536414:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260901888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784403501.536472:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403501.536563:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260901888 00000100:00100000:2.0:1784403501.536570:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260901888 00000100:00100000:2.0:1784403501.536641:0:15430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784403501.536650:0:15430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3567:x1871082260901888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784403501.536816:0:15430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784403501.536820:0:15430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1784403501.536823:0:15430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784403501.536826:0:15430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784403501 -> 1784403501 00002000:00010000:2.0:1784403501.536828:0:15430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784403501.537097:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9791971e-5366-412b-99ee-4875c7fc85e0+14:14480:x1871082240994432:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 Request processed in 97434us (101338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403501.537107:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:2.0:1784403501.537227:0:15430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3567:x1871082260901888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 577us (754us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1784403501.537234:0:15430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:0.0:1784403501.537329:0:3567:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c8a77e14000/2, rc 0, transno 8589934595 00000100:00100000:0.0:1784403501.537336:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260901888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784403501.545648:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.545774:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240994560 00000100:00100000:1.0:1784403501.545844:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240994560 00000100:00100000:1.0:1784403501.545974:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:1.0:1784403501.545987:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9791971e-5366-412b-99ee-4875c7fc85e0+7:2360:x1871082240994560:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1784403501.546118:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9791971e-5366-412b-99ee-4875c7fc85e0+7:2360:x1871082240994560:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 Request processed in 134us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403501.546126:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:3.0:1784403501.550556:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.552195:0:16679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240994816 00000100:00100000:1.0:1784403501.552214:0:16679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240994816 00000100:00100000:1.0:1784403501.552295:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:1.0:1784403501.552307:0:16679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9791971e-5366-412b-99ee-4875c7fc85e0+14:14480:x1871082240994816:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784403501.552374:0:16679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784403501.552405:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0600/0x6828175665afbd41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efff expref: 14 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.552426:0:16679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a47dbda00) 00010000:00010000:1.0:1784403501.552431:0:16679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784403501.552462:0:16679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.552477:0:16679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.552487:0:16679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784403501.552842:0:16679:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000060c78a4 reply state 0000000086514c0b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403501.552854:0:16679:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784403501.553017:0:16679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9791971e-5366-412b-99ee-4875c7fc85e0+15:14480:x1871082240994816:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 711us (2470us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1784403501.553026:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00010000:00010000:0.0:1784403501.555359:0:3551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.555377:0:3551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403501.555389:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1784403501.555390:0:3551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.555398:0:3551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a1e00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:0.0:1784403501.555402:0:3551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.555413:0:3551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.555432:0:3551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a47dbda00) 00010000:00010000:0.0:1784403501.555436:0:3551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784403501.555441:0:3551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.555447:0:3551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1e00/0x6828175665afbd4f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403501.555795:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240994944 00000100:00100000:2.0:1784403501.555805:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240994944 00000100:00100000:2.0:1784403501.555899:0:15430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:2.0:1784403501.555911:0:15430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9791971e-5366-412b-99ee-4875c7fc85e0+7:14480:x1871082240994944:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784403501.555930:0:15430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784403501.555951:0:15430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8940f1fd0890f00d expref: -99 pid: 15430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.555986:0:15430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afbd48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f006 expref: 8 pid: 15429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.555997:0:15430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784403501.556002:0:15430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403501.556008:0:15430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 8 pid: 15430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.556051:0:15430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afbd48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f006 expref: 8 pid: 15429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.556074:0:15430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afbd48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f006 expref: 8 pid: 15429 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403501.556089:0:15430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15430:1871082260902016:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403501.556186:0:15430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fd540 going to sleep for 11 seconds 00000100:00100000:2.0:1784403501.559992:0:15430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15430:1871082260902016:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403501.560039:0:15430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 8 pid: 15430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.560068:0:15430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c8a7b5b3200, rc 0) 00000100:00100000:2.0:1784403501.560149:0:15430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9791971e-5366-412b-99ee-4875c7fc85e0+8:14480:x1871082240994944:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 4238us (4765us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403501.560159:0:15430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:3.0:1784403501.563990:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.564075:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240995072 00000100:00100000:1.0:1784403501.564087:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240995072 00010000:00010000:0.0:1784403501.564295:0:14784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afbd48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f006 expref: 8 pid: 15429 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403501.564393:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:0.0:1784403501.564404:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9791971e-5366-412b-99ee-4875c7fc85e0+8:2361:x1871082240995072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403501.564422:0:14784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403501.564448:0:14784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afbd48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f006 expref: 8 pid: 15429 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.564463:0:14784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afbd48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f006 expref: 8 pid: 15429 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.564490:0:14784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000969cd8ec/0x6828175665afbd48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f006 expref: 8 pid: 15429 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.564520:0:14784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403501.564525:0:14784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403501.564533:0:14784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 7 pid: 15430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.564544:0:14784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 7 pid: 15430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.564597:0:14784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 7 pid: 15430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403501.564632:0:14784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b626300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14784:1871082260902144:192.168.204.28@tcp:105: 00000100:00100000:0.0:1784403501.564729:0:14784:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a42bbc540 going to sleep for 11 seconds 00000100:00100000:3.0:1784403501.578512:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403501.578672:0:14784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b626300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14784:1871082260902144:192.168.204.28@tcp:105: 00010000:00010000:0.0:1784403501.578697:0:14784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403501.578756:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9791971e-5366-412b-99ee-4875c7fc85e0+7:2361:x1871082240995072:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 14352us (14774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403501.578769:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:2.0:1784403501.578930:0:15768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240995200 00000100:00100000:2.0:1784403501.578938:0:15768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240995200 00000100:00100000:2.0:1784403501.578992:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:2.0:1784403501.579003:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9791971e-5366-412b-99ee-4875c7fc85e0+7:2361:x1871082240995200:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784403501.579243:0:15768:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784403501.579247:0:15768:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1784403500 00002000:00010000:2.0:1784403501.579249:0:15768:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1784403499 00002000:00010000:2.0:1784403501.579251:0:15768:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784403501 -> 1784403500 00002000:00010000:2.0:1784403501.579254:0:15768:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1784403501.579290:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9791971e-5366-412b-99ee-4875c7fc85e0+8:2361:x1871082240995200:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 290us (788us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1784403501.579312:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:3.0:1784403501.582604:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.582770:0:15431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240995328 00000100:00100000:1.0:1784403501.582792:0:15431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240995328 00000100:00100000:1.0:1784403501.582898:0:15431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1784403501.582911:0:15431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9791971e-5366-412b-99ee-4875c7fc85e0+8:2360:x1871082240995328:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784403501.582964:0:15431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.583006:0:15431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 8 pid: 15430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.583015:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403501.583021:0:15431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784403501.583028:0:15431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.583070:0:15431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 8 pid: 15430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.583087:0:15431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 8 pid: 15430 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403501.583105:0:15431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15431:1871082260902272:192.168.204.28@tcp:104: 00000100:00100000:1.0:1784403501.583203:0:15431:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a514613c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784403501.586440:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403501.586646:0:14783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240995456 00000100:00100000:2.0:1784403501.586657:0:14783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240995456 00010000:00010000:2.0:1784403501.586701:0:14783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 9 pid: 15430 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403501.586743:0:14783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1784403501.586754:0:14783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9791971e-5366-412b-99ee-4875c7fc85e0+9:2361:x1871082240995456:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784403501.586771:0:14783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784403501.586809:0:14783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 9 pid: 15430 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.586825:0:14783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 9 pid: 15430 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.586853:0:14783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784403501.586858:0:14783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784403501.587014:0:14783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.587029:0:14783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.587055:0:14783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784403501.587113:0:14783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9791971e-5366-412b-99ee-4875c7fc85e0+9:2361:x1871082240995456:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 360us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403501.587136:0:14783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00010000:00010000:1.0:1784403501.592115:0:15431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aa09bb3/0x6828175665afbd56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890f00d expref: 8 pid: 15430 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403501.592143:0:15431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15431:1871082260902272:192.168.204.28@tcp:104: 00010000:00010000:1.0:1784403501.592174:0:15431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.592187:0:15431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.592214:0:15431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.592256:0:15431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.592264:0:15431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.592272:0:15431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.592280:0:15431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403501.592284:0:15431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.592293:0:15431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.592316:0:15431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.592324:0:15431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbd5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403501.593067:0:15431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9791971e-5366-412b-99ee-4875c7fc85e0+7:2360:x1871082240995328:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 Request processed in 10154us (10477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403501.593078:0:15431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:3.0:1784403501.596422:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.596506:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240995712 00000100:00100000:1.0:1784403501.596517:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240995712 00000100:00100000:1.0:1784403501.596598:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:1.0:1784403501.596610:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+14:14480:x1871082240995712:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784403501.596709:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbd64 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.596729:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbd64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.596742:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbd64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.597660:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.597678:0:14797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd33 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff8 expref: 15 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.597687:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.597729:0:14797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff8 expref: 15 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.597743:0:14797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd33 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff8 expref: 15 pid: 14797 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403501.597760:0:14797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14797:1871082260902400:192.168.204.28@tcp:104: 00000100:00100000:2.0:1784403501.598007:0:14797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fd180 going to sleep for 11 seconds 00000100:00100000:3.0:1784403501.601014:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1784403501.601017:0:14797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14797:1871082260902400:192.168.204.28@tcp:104: 00010000:00010000:2.0:1784403501.601048:0:14797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403501.601107:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240995840 00000100:00100000:0.0:1784403501.601115:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240995840 00010000:00010000:0.0:1784403501.601153:0:14784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd33 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff8 expref: 16 pid: 14797 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403501.601196:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:0.0:1784403501.601206:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9791971e-5366-412b-99ee-4875c7fc85e0+16:2360:x1871082240995840:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784403501.601223:0:14784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784403501.601230:0:14784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd33 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff8 expref: 16 pid: 14797 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.601243:0:14784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff8 expref: 16 pid: 14797 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.601267:0:14784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a1600/0x6828175665afbd33 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890eff8 expref: 16 pid: 14797 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.601316:0:14784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a47dbda00) 00010000:00010000:0.0:1784403501.601322:0:14784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.601332:0:14784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.601340:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.601361:0:14784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784403501.601434:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9791971e-5366-412b-99ee-4875c7fc85e0+15:2360:x1871082240995840:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 227us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403501.601442:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00010000:00010000:2.0:1784403501.602394:0:14797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.602405:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784403501.602703:0:14797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1784403501.602967:0:14797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1784403501.603021:0:14797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1784403501.603270:0:14797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14797:1871082260902528:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784403501.603493:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403501.603584:0:14797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a43f92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784403501.603714:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260902528 00000100:00100000:1.0:1784403501.603721:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260902528 00000100:00100000:1.0:1784403501.603760:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784403501.603772:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14797:x1871082260902528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784403501.604049:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14797:x1871082260902528:12345-0@lo:1000:mdt00_001.0 Request processed in 279us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403501.604056:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784403501.605803:0:14797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14797:1871082260902528:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1784403501.608315:0:14797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1784403501.608420:0:14797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14797:1871082260902656:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784403501.608483:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784403501.608509:0:14797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1784403501.611742:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260902656 00000100:00100000:0.0:1784403501.611759:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260902656 00000100:00100000:0.0:1784403501.611825:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784403501.611837:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14797:x1871082260902656:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784403501.612130:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14797:x1871082260902656:12345-0@lo:1000:mdt00_001.0 Request processed in 294us (3644us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1784403501.612138:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784403501.613747:0:14797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14797:1871082260902656:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1784403501.613995:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614008:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614017:0:14797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614024:0:14797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3800 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403501.614029:0:14797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614037:0:14797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614079:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a47dbda00) 00010000:00010000:2.0:1784403501.614082:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784403501.614086:0:14797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614092:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd6b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614128:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614136:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614142:0:14797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614147:0:14797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0a00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:2.0:1784403501.614151:0:14797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614157:0:14797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614165:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:2.0:1784403501.614167:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784403501.614176:0:14797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbcca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efdc expref: 18 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614190:0:14797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbcca lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efdc expref: 18 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614207:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbcca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efdc expref: 18 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.614278:0:14797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b2e00/0x6828175665afbcca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x8940f1fd0890efdc expref: 18 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403501.614293:0:14797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14797:1871082260902784:192.168.204.28@tcp:105: 00000100:00100000:2.0:1784403501.614518:0:14797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8c8a527fd540 going to sleep for 11 seconds 00000100:00100000:2.0:1784403501.618784:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.618887:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240995968 00000100:00100000:1.0:1784403501.618898:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240995968 00000100:00100000:1.0:1784403501.618954:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:1.0:1784403501.618963:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fe84450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9791971e-5366-412b-99ee-4875c7fc85e0+19:14479:x1871082240995968:12345-192.168.204.28@tcp:49:dd.0 00000100:00100000:3.0:1784403501.619704:0:14797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14797:1871082260902784:192.168.204.28@tcp:105: 00010000:00010000:3.0:1784403501.619735:0:14797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619745:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0a00/0x6828175665afbcc3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619779:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd72 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619793:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619805:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619827:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619834:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd72 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619841:0:14797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd72 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619855:0:14797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7000 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403501.619890:0:14797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd72 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619898:0:14797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd72 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619910:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:3.0:1784403501.619913:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784403501.619915:0:14797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd72 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619920:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7fce7000/0x6828175665afbd72 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619931:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbd64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619937:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbd64 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619942:0:14797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbd64 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619948:0:14797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0c00 already unused, calling callback (ffffffffc1ed84f0) 00010000:00010000:3.0:1784403501.619950:0:14797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbd64 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619956:0:14797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbd64 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619962:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c8a58960c00) 00010000:00010000:3.0:1784403501.619965:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784403501.619974:0:14797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbd64 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.619979:0:14797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a734a0c00/0x6828175665afbd64 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403501.620514:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fe84450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9791971e-5366-412b-99ee-4875c7fc85e0+19:14479:x1871082240995968:12345-192.168.204.28@tcp:49:dd.0 Request processed in 1550us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403501.620525:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1784403501.620628:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+18:14480:x1871082240995712:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 24020us (24216us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1784403501.620637:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00000020:00080000:3.0:1784403501.620641:0:14797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784403501.624425:0:14830:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784403501.624437:0:14830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784403501.624495:0:14830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784403501.624503:0:14830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1784403501.627256:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403501.627641:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240996224 00000100:00100000:3.0:1784403501.627652:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240996224 00000100:00100000:3.0:1784403501.627706:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:3.0:1784403501.627717:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9791971e-5366-412b-99ee-4875c7fc85e0+18:14480:x1871082240996224:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784403501.634253:0:14800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784403501.635243:0:14800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1784403501.635335:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.635356:0:14800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.636016:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.636042:0:14800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.636050:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.636057:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403501.636096:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784403501.636298:0:15770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784403501.636306:0:15770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.636313:0:15770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403501.636317:0:15770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.636324:0:15770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.636338:0:15770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c8a47dbda00) 00010000:00010000:1.0:1784403501.636341:0:15770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784403501.636346:0:15770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.636353:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c8a7b5b3800/0x6828175665afbd79 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403501.636376:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403501.636378:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784403501.636380:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403501.636478:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9791971e-5366-412b-99ee-4875c7fc85e0+20:14480:x1871082240996224:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 8748us (9217us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1784403501.636491:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000020:00080000:2.0:1784403501.636499:0:14800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784403501.793174:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784403501.852913:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403501.852984:0:3559:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403501.853372:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1784403501.862500:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240996352 00000100:00100000:0.0:1784403501.862518:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240996352 00000100:00100000:0.0:1784403501.862601:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240996480 00000100:00100000:0.0:1784403501.862605:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240996480 00000100:00100000:0.0:1784403501.862621:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240996608 00000100:00100000:0.0:1784403501.862640:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240996608 00000100:00100000:0.0:1784403501.862670:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:0.0:1784403501.862681:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9791971e-5366-412b-99ee-4875c7fc85e0+9:2361:x1871082240996352:12345-192.168.204.28@tcp:4:dd.0 00002000:00010000:0.0:1784403501.862743:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a5bd62c, atime: 0x6a5bd62b, ctime: 0x6a5bd62c, blocks: 0x1 00010000:00010000:0.0:1784403501.862754:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afbd80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.862773:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1784403501.862777:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403501.862784:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afbd80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403501.862799:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afbd80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403501.863976:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403501.864000:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403501.864014:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403501.864028:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1784403501.864044:0:3560:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403501.867188:0:15436:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784403501.867206:0:15436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1784403501.867536:0:15435:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1784403501.867702:0:15435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240996736 00000100:00100000:3.0:1784403501.867713:0:15435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240996736 00000100:00100000:3.0:1784403501.867770:0:15435:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1784403501.867776:0:15435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240996864 00000100:00100000:3.0:1784403501.867779:0:15435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240996864 00000100:00100000:3.0:1784403501.867793:0:15435:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1784403501.867805:0:15435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240996992 00000100:00100000:3.0:1784403501.867808:0:15435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240996992 00000100:00100000:3.0:1784403501.867825:0:15435:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1784403501.867830:0:15435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240997120 00000100:00100000:3.0:1784403501.867832:0:15435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240997120 00000100:00100000:3.0:1784403501.867843:0:15435:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1784403501.867848:0:15435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240997248 00000100:00100000:3.0:1784403501.867850:0:15435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240997248 00000100:00100000:3.0:1784403501.869574:0:16932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:3.0:1784403501.869815:0:16932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9791971e-5366-412b-99ee-4875c7fc85e0+15:2361:x1871082240996480:12345-192.168.204.28@tcp:4:dd.0 00010000:00010000:3.0:1784403501.869861:0:16932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afbd87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.869903:0:16932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403501.869908:0:16932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784403501.869915:0:16932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afbd87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403501.870410:0:16932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afbd87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403502.016787:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1784403502.016812:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:1.0:1784403502.016819:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1784403502.016847:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1784403502.022276:0:15438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1784403502.022300:0:15438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1784403500 -> 1784403502 00002000:00010000:0.0:1784403502.022303:0:15438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784403500 -> 1784403502 00002000:00010000:0.0:1784403502.022306:0:15438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:0.0:1784403502.022326:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afbd80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.022342:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afbd80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.022352:0:15438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afbd80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.022384:0:15438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce4c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403502.022389:0:15438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afbd80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.022399:0:15438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afbd80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.022442:0:15438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afbd80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.022450:0:15438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979a7ce6/0x6828175665afbd80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403502.022564:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9791971e-5366-412b-99ee-4875c7fc85e0+15:2361:x1871082240996352:12345-192.168.204.28@tcp:4:dd.0 Request processed in 159878us (169696us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1784403502.022575:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:0.0:1784403502.022652:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:0.0:1784403502.022665:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9791971e-5366-412b-99ee-4875c7fc85e0+14:2360:x1871082240996608:12345-192.168.204.28@tcp:4:dd.0 00010000:00010000:0.0:1784403502.022704:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c522a530/0x6828175665afbd8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.022717:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403502.022723:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403502.022731:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c522a530/0x6828175665afbd8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.022755:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c522a530/0x6828175665afbd8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403502.078308:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1784403502.078918:0:16932:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00010000:00010000:2.0:1784403502.078940:0:16932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afbd87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.078955:0:16932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afbd87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.078964:0:16932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afbd87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.078972:0:16932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce7000 already unused, calling callback (ffffffffc149a230) 00010000:00010000:2.0:1784403502.078978:0:16932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afbd87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.078986:0:16932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afbd87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.079009:0:16932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afbd87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.079035:0:16932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000837d456/0x6828175665afbd87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403502.079131:0:16932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9791971e-5366-412b-99ee-4875c7fc85e0+14:2361:x1871082240996480:12345-192.168.204.28@tcp:4:dd.0 Request processed in 209318us (226141us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1784403502.079142:0:16932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:2.0:1784403502.079175:0:16932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:2.0:1784403502.079187:0:16932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9791971e-5366-412b-99ee-4875c7fc85e0+13:2360:x1871082240996736:12345-192.168.204.28@tcp:4:dd.0 00010000:00010000:2.0:1784403502.079219:0:16932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbd95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.079231:0:16932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403502.079236:0:16932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403502.079243:0:16932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbd95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.079256:0:16932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbd95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403502.129371:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1784403502.135521:0:15438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1784403502.135533:0:15438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:0.0:1784403502.135550:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c522a530/0x6828175665afbd8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.135564:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c522a530/0x6828175665afbd8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.135573:0:15438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c522a530/0x6828175665afbd8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.135591:0:15438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5c00 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403502.135596:0:15438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c522a530/0x6828175665afbd8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.135606:0:15438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c522a530/0x6828175665afbd8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.135631:0:15438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c522a530/0x6828175665afbd8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.135639:0:15438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c522a530/0x6828175665afbd8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403502.135769:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9791971e-5366-412b-99ee-4875c7fc85e0+13:2360:x1871082240996608:12345-192.168.204.28@tcp:4:dd.0 Request processed in 113101us (282392us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1784403502.135779:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:0.0:1784403502.135951:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:0.0:1784403502.135964:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9791971e-5366-412b-99ee-4875c7fc85e0+12:2361:x1871082240996864:12345-192.168.204.28@tcp:4:dd.0 00010000:00010000:0.0:1784403502.136000:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afbd9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.136014:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403502.136019:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784403502.136026:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afbd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.136038:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afbd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784403502.176574:0:16932:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00010000:00010000:2.0:1784403502.176607:0:16932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbd95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.176621:0:16932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbd95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.176650:0:16932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbd95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.176659:0:16932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:2.0:1784403502.176664:0:16932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbd95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.176674:0:16932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbd95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.176707:0:16932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbd95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.176716:0:16932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbd95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403502.176827:0:16932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9791971e-5366-412b-99ee-4875c7fc85e0+14:2360:x1871082240996736:12345-192.168.204.28@tcp:4:dd.0 Request processed in 97638us (312851us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1784403502.176839:0:16932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:2.0:1784403502.176908:0:16932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:2.0:1784403502.176921:0:16932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7ae7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9791971e-5366-412b-99ee-4875c7fc85e0+13:2361:x1871082240996992:12345-192.168.204.28@tcp:4:dd.0 00010000:00010000:2.0:1784403502.176955:0:16932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afbda3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.176968:0:16932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403502.176979:0:16932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403502.176986:0:16932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afbda3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.177000:0:16932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afbda3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403502.177668:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1784403502.221664:0:15438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:1.0:1784403502.221676:0:15438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1784403502.221762:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afbd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403502.221777:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afbd9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403502.221786:0:15438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afbd9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403502.221794:0:15438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7fce5800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:1.0:1784403502.221799:0:15438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afbd9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403502.221808:0:15438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afbd9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403502.221830:0:15438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afbd9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403502.221838:0:15438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b705993b/0x6828175665afbd9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784403502.222019:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9791971e-5366-412b-99ee-4875c7fc85e0+13:2361:x1871082240996864:12345-192.168.204.28@tcp:4:dd.0 Request processed in 86053us (358011us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1784403502.222032:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:1.0:1784403502.222068:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:1.0:1784403502.222083:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9791971e-5366-412b-99ee-4875c7fc85e0+12:2361:x1871082240997120:12345-192.168.204.28@tcp:4:dd.0 00010000:00010000:1.0:1784403502.222122:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbdaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403502.222136:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403502.222141:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784403502.222147:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbdaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784403502.222159:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbdaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784403502.222296:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:3.0:1784403502.284454:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1784403502.284944:0:16932:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1784403502.284950:0:16932:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1784403502.284968:0:16932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afbda3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.284984:0:16932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afbda3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.284994:0:16932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afbda3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.285004:0:16932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b2800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:2.0:1784403502.285010:0:16932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afbda3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.285019:0:16932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afbda3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.285043:0:16932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afbda3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.285068:0:16932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a80589c7/0x6828175665afbda3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784403502.285166:0:16932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7ae7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9791971e-5366-412b-99ee-4875c7fc85e0+10:2361:x1871082240996992:12345-192.168.204.28@tcp:4:dd.0 Request processed in 108244us (421143us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784403502.285177:0:16932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:2.0:1784403502.285210:0:16932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1784403502.285222:0:16932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8943275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9791971e-5366-412b-99ee-4875c7fc85e0+9:2361:x1871082240997248:12345-192.168.204.28@tcp:4:dd.0 00010000:00010000:2.0:1784403502.285257:0:16932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbdb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.285270:0:16932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403502.285276:0:16932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784403502.285283:0:16932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbdb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784403502.285296:0:16932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbdb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784403502.335192:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1784403502.336008:0:15438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1784403502.336025:0:15438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1784403502.336044:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbdaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403502.336060:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbdaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403502.336091:0:15438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbdaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403502.336099:0:15438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a734a0600 already unused, calling callback (ffffffffc149a230) 00010000:00010000:3.0:1784403502.336104:0:15438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbdaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403502.336115:0:15438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbdaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403502.336137:0:15438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbdaa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784403502.336146:0:15438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000396e6a51/0x6828175665afbdaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784403502.336243:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9791971e-5366-412b-99ee-4875c7fc85e0+9:2361:x1871082240997120:12345-192.168.204.28@tcp:4:dd.0 Request processed in 114161us (472208us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1784403502.336254:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000001:00080000:2.0:1784403502.467537:0:7124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1784403502.468049:0:16932:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1784403502.468067:0:16932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbdb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.468086:0:16932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbdb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.468097:0:16932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbdb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.468120:0:16932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c8a7b5b3800 already unused, calling callback (ffffffffc149a230) 00010000:00010000:0.0:1784403502.468126:0:16932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbdb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.468135:0:16932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbdb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.468159:0:16932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbdb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784403502.468168:0:16932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a85c88b2/0x6828175665afbdb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784403502.468591:0:16932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8943275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9791971e-5366-412b-99ee-4875c7fc85e0+5:2361:x1871082240997248:12345-192.168.204.28@tcp:4:dd.0 Request processed in 183365us (604537us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1784403502.468603:0:16932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00010000:00010000:3.0:1784403502.815470:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784403502.819362:0:3565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:001064a9-3cb5-489b-ba0a-bb457082004b:3565:1871082260903040:0@lo:400:kworker.0 00000100:00100000:3.0:1784403502.819399:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260903168:0@lo:400:kworker.0 00000100:00100000:2.0:1784403502.819433:0:3565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403502.819541:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a77cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260902912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784403502.820287:0:3567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260903296:0@lo:400:kworker.0 00000100:00100000:3.0:1784403502.821804:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403502.821914:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260903680:0@lo:400:kworker.0 00000100:00100000:3.0:1784403502.821972:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403502.822288:0:3566:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784403502.822295:0:3566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260903552:0@lo:400:kworker.0 00000100:00100000:3.0:1784403502.822322:0:3566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784403502.822375:0:16679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260903680 00000100:00100000:3.0:1784403502.822383:0:16679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260903680 00000100:00100000:3.0:1784403502.822437:0:16679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260903552 00000100:00100000:3.0:1784403502.822440:0:16679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260903552 00000100:00100000:3.0:1784403502.822465:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784403502.822474:0:16679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260903680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403502.822530:0:16679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3566:x1871082260903680:12345-0@lo:400:kworker.0 Request processed in 56us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403502.822538:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784403502.822555:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784403502.822560:0:16679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260903552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403502.822601:0:16679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3566:x1871082260903552:12345-0@lo:400:kworker.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403502.822607:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1784403502.822624:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784403502.822669:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3566:1871082260903552:0@lo:400:kworker.0 00000100:00100000:3.0:1784403502.822681:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3566:1871082260903680:0@lo:400:kworker.0 00000100:00100000:3.0:1784403502.822727:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260903040 00000100:00100000:3.0:1784403502.822731:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260903040 00000100:00100000:3.0:1784403502.822760:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784403502.822766:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+19:3565:x1871082260903040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403502.822800:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001064a9-3cb5-489b-ba0a-bb457082004b+19:3565:x1871082260903040:12345-0@lo:400:kworker.0 Request processed in 35us (3367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403502.822817:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784403502.822855:0:15768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260903168 00000100:00100000:3.0:1784403502.822859:0:15768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260903168 00000100:00100000:3.0:1784403502.822918:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784403502.822924:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260903168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784403502.822962:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3566:x1871082260903168:12345-0@lo:400:kworker.0 Request processed in 38us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784403502.822967:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1784403502.822985:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784403502.823266:0:3566:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1784403502.823273:0:3566:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c8a77e14000, transno 8589934595 00000004:00080000:3.0:1784403502.823286:0:3566:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1784403502.823303:0:3566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3566:1871082260903168:0@lo:400:kworker.0 00000100:00100000:1.0:1784403502.826608:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403502.826669:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a72e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260903424:0@lo:400:kworker.0 00000100:00100000:1.0:1784403502.826705:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403502.826752:0:16679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260903424 00000100:00100000:1.0:1784403502.826759:0:16679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260903424 00000100:00100000:1.0:1784403502.826806:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784403502.826816:0:16679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260903424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784403502.827120:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260902912 00000100:00100000:2.0:1784403502.827136:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260902912 00000100:00100000:3.0:1784403502.827150:0:3565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:001064a9-3cb5-489b-ba0a-bb457082004b:3565:1871082260903040:0@lo:400:kworker.0 00000100:00100000:1.0:1784403502.827371:0:16679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3568:x1871082260903424:12345-0@lo:400:kworker.0 Request processed in 555us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403502.827379:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784403502.827416:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3568:1871082260903424:0@lo:400:kworker.0 00000100:00100000:0.0:1784403502.827751:0:3567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784403502.829504:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260903296 00000100:00100000:1.0:1784403502.829516:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260903296 00000100:00100000:1.0:1784403502.829594:0:15430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784403502.829605:0:15430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a7b624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3567:x1871082260903296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784403502.829698:0:15430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a7b624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3567:x1871082260903296:12345-0@lo:400:kworker.0 Request processed in 95us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403502.829705:0:15430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784403502.829853:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784403502.829880:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260902912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784403502.829915:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784403502.829961:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260902912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784403502.829967:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784403502.829994:0:3567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a72e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3567:1871082260903296:0@lo:400:kworker.0 00000100:00100000:2.0:1784403502.830000:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a77cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260902912:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784403502.830349:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784403503.849433:0:15770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403504.197475:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403504.197530:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403504.197573:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403504.197600:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403504.197637:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403504.197659:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403504.197687:0:3558:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1784403504.197719:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240997504 00000100:00100000:1.0:1784403504.197731:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240997504 00000100:00100000:1.0:1784403504.197808:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240997888 00000100:00100000:1.0:1784403504.197812:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240997888 00000100:00100000:1.0:1784403504.197841:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:1.0:1784403504.197853:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a77e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+20:2361:x1871082240997504:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403504.197986:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a77e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9791971e-5366-412b-99ee-4875c7fc85e0+20:2361:x1871082240997504:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 135us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403504.198015:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:1.0:1784403504.198036:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:1.0:1784403504.198043:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+6:2361:x1871082240997888:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403504.198076:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6f18205-6d4d-463b-9cd7-d615580287c7+6:2361:x1871082240997888:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403504.198082:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:1.0:1784403504.198102:0:15768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240997760 00000100:00100000:1.0:1784403504.198106:0:15768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240997760 00000100:00100000:1.0:1784403504.198127:0:15768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240998016 00000100:00100000:1.0:1784403504.198129:0:15768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240998016 00000100:00100000:1.0:1784403504.198141:0:15768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240997632 00000100:00100000:1.0:1784403504.198143:0:15768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240997632 00000100:00100000:1.0:1784403504.198154:0:15768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240998144 00000100:00100000:1.0:1784403504.198156:0:15768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240998144 00000100:00100000:1.0:1784403504.198170:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:1.0:1784403504.198176:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9791971e-5366-412b-99ee-4875c7fc85e0+5:2361:x1871082240997760:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403504.198204:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9791971e-5366-412b-99ee-4875c7fc85e0+5:2361:x1871082240997760:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 28us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403504.198210:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:1.0:1784403504.198222:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:1.0:1784403504.198227:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a72a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2361:x1871082240998016:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403504.198253:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a72a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2361:x1871082240998016:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 26us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403504.198259:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:1.0:1784403504.198422:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:1.0:1784403504.198436:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9791971e-5366-412b-99ee-4875c7fc85e0+5:2361:x1871082240997632:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403504.198467:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9791971e-5366-412b-99ee-4875c7fc85e0+5:2361:x1871082240997632:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 32us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403504.198474:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:1.0:1784403504.198485:0:15768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:1.0:1784403504.198491:0:15768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2361:x1871082240998144:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403504.198517:0:15768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6f18205-6d4d-463b-9cd7-d615580287c7+5:2361:x1871082240998144:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403504.198523:0:15768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:1.0:1784403504.198562:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082240997376 00000100:00100000:1.0:1784403504.198567:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082240997376 00000100:00100000:1.0:1784403504.198599:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:1.0:1784403504.198606:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a453a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+13:2361:x1871082240997376:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1784403504.198630:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a453a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c12d25a6-6fec-420f-abaf-beb60f397179+13:2361:x1871082240997376:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1784403504.198637:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00080000:1.0:1784403504.198677:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784403504.198682:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784403504.198685:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1784403504.442266:0:16969:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1784403504.866073:0:14785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784403505.887150:0:14786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784403505.887425:0:3568:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784403505.887462:0:3568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8c8a7b626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260903808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784403505.887577:0:3568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784403505.888843:0:15434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871082260903808 00000100:00100000:0.0:1784403505.888858:0:15434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871082260903808 00000100:00100000:0.0:1784403505.888967:0:15434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784403505.888979:0:15434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260903808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784403505.889018:0:15434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00080000:1.0:1784403505.889484:0:14793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784403505.890432:0:15434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c8a52370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3568:x1871082260903808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1449us (2848us total) trans 0 rc 0/0 00000100:00100000:0.0:1784403505.890444:0:15434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784403505.895435:0:3568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8c8a7b626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3568:1871082260903808:0@lo:13:osp-pre-0-0.0 Debug log: 29832 lines, 29832 kept, 0 dropped, 0 bad.