[ 1553.073078] Lustre: *** cfs_fail_loc=513, val=601*** [ 1553.518315] LustreError: 18998:0:(service.c:2284:ptlrpc_server_handle_req_in()) drop incoming rpc opc 601, x1835627556196480 [ 1553.599567] Lustre: *** cfs_fail_loc=513, val=601*** [ 1553.604997] Lustre: Skipped 25 previous similar messages [ 1556.916405] Lustre: *** cfs_fail_loc=513, val=601*** [ 1556.918175] Lustre: Skipped 16 previous similar messages [ 1559.203222] Lustre: *** cfs_fail_loc=513, val=601*** [ 1559.205361] Lustre: Skipped 7 previous similar messages [ 1563.538301] Lustre: *** cfs_fail_loc=513, val=601*** [ 1563.546361] Lustre: Skipped 4 previous similar messages [ 1570.268352] Lustre: 3769:0:(client.c:2453:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1750592348/real 1750592348] req@ffff88013306ce00 x1835627556196480/t0(0) o601->lustre-MDT0000-lwp-OST0001@0@lo:23/10 lens 336/336 e 0 to 1 dl 1750592364 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ll_ost_io00_000.0' uid:0 gid:0 projid:4294967295 [ 1570.287092] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1570.307595] Lustre: lustre-MDT0000: Client lustre-MDT0000-lwp-OST0001_UUID (at 0@lo) reconnecting [ 1570.314140] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 192.168.204.113@tcp (at 0@lo) [ 1571.320691] LustreError: 18998:0:(service.c:2284:ptlrpc_server_handle_req_in()) drop incoming rpc opc 601, x1835627556208128 [ 1571.955534] Lustre: *** cfs_fail_loc=513, val=601*** [ 1571.957870] Lustre: Skipped 63 previous similar messages [ 1587.325890] Lustre: 9600:0:(client.c:2453:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1750592366/real 1750592366] req@ffff88007af57480 x1835627556208128/t0(0) o601->lustre-MDT0000-lwp-OST0001@0@lo:23/10 lens 336/336 e 0 to 1 dl 1750592382 ref 2 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ll_ost_io00_000.0' uid:0 gid:0 projid:4294967295 [ 1587.338489] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1587.355443] Lustre: lustre-MDT0000: Client lustre-MDT0000-lwp-OST0001_UUID (at 0@lo) reconnecting [ 1587.373405] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 192.168.204.113@tcp (at 0@lo) [ 1588.594312] Lustre: *** cfs_fail_loc=513, val=601*** [ 1588.596252] Lustre: Skipped 84 previous similar messages [ 1589.407060] LustreError: 18998:0:(service.c:2284:ptlrpc_server_handle_req_in()) drop incoming rpc opc 601, x1835627556217856 [ 1605.410869] Lustre: 9600:0:(client.c:2453:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1750592384/real 1750592384] req@ffff880099ef4e00 x1835627556217856/t0(0) o601->lustre-MDT0000-lwp-OST0001@0@lo:23/10 lens 336/336 e 0 to 1 dl 1750592400 ref 2 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ll_ost_io00_000.0' uid:0 gid:0 projid:4294967295 [ 1605.426133] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1605.435576] Lustre: lustre-MDT0000: Client lustre-MDT0000-lwp-OST0001_UUID (at 0@lo) reconnecting [ 1605.438948] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 192.168.204.113@tcp (at 0@lo) [ 1625.296395] Lustre: DEBUG MARKER: == sanity-quota test 7a: Quota reintegration (global index) ========================================================== 07:40:19 (1750592419) [ 1640.984600] Lustre: Failing over lustre-OST0000 [ 1641.028908] LustreError: 22029:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1641.061973] Lustre: server umount lustre-OST0000 complete [ 1643.715371] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1643.723564] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1644.275306] LustreError: 22398:0:(qsd_reint.c:620:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed. [ 1644.280302] LustreError: 22398:0:(qsd_reint.c:620:qqi_reint_delayed()) Skipped 11 previous similar messages [ 1648.388910] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1648.393847] in_atomic(): 1, irqs_disabled(): 0, pid: 22893, name: mount.lustre [ 1648.397705] CPU: 2 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1648.403800] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1648.416768] Call Trace: [ 1648.418221] [] dump_stack+0x19/0x1b [ 1648.421056] [] __might_sleep+0xd9/0x100 [ 1648.423407] [] kmem_cache_alloc+0x4f/0x2e0 [ 1648.425297] [] alloc_vfsmnt+0x24/0x240 [ 1648.427899] [] vfs_kern_mount+0x36/0x110 [ 1648.433366] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1648.439236] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1648.443201] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1648.449845] [] obd_setup+0x167/0x540 [obdclass] [ 1648.460503] [] class_setup+0x54f/0x830 [obdclass] [ 1648.464749] [] class_process_config+0x149b/0x2660 [obdclass] [ 1648.468012] [] ? __kmalloc+0x1e0/0x340 [ 1648.469936] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1648.475599] [] do_lcfg+0x263/0x520 [obdclass] [ 1648.488016] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1648.498381] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1648.503154] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1648.508795] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1648.511938] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1648.517270] [] mount_nodev+0x4d/0xb0 [ 1648.519665] [] lustre_mount+0x18/0x20 [lustre] [ 1648.525187] [] mount_fs+0x39/0x1b0 [ 1648.527644] [] vfs_kern_mount+0x67/0x110 [ 1648.530189] [] do_mount+0x1ef/0xce0 [ 1648.534263] [] ? copy_mount_options+0x39/0x1b0 [ 1648.540597] [] SyS_mount+0x83/0xd0 [ 1648.545964] [] system_call_fastpath+0x1f/0x24 [ 1648.552060] BUG: scheduling while atomic: mount.lustre/22893/0x10000002 [ 1648.554686] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1648.583455] CPU: 2 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1648.597254] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1648.605285] Call Trace: [ 1648.609850] [] dump_stack+0x19/0x1b [ 1648.614589] [] __schedule_bug+0x64/0x72 [ 1648.617315] [] __schedule+0x791/0x7d0 [ 1648.623940] [] ? alloc_vfsmnt+0x24/0x240 [ 1648.625636] [] __cond_resched+0x26/0x30 [ 1648.633591] [] _cond_resched+0x3a/0x50 [ 1648.637571] [] kmem_cache_alloc+0x54/0x2e0 [ 1648.641614] [] alloc_vfsmnt+0x24/0x240 [ 1648.646927] [] vfs_kern_mount+0x36/0x110 [ 1648.651728] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1648.657412] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1648.660957] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1648.663756] [] obd_setup+0x167/0x540 [obdclass] [ 1648.666672] [] class_setup+0x54f/0x830 [obdclass] [ 1648.670846] [] class_process_config+0x149b/0x2660 [obdclass] [ 1648.674302] [] ? __kmalloc+0x1e0/0x340 [ 1648.678686] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1648.687390] [] do_lcfg+0x263/0x520 [obdclass] [ 1648.692939] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1648.699420] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1648.710640] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1648.714411] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1648.718193] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1648.724620] [] mount_nodev+0x4d/0xb0 [ 1648.728546] [] lustre_mount+0x18/0x20 [lustre] [ 1648.732323] [] mount_fs+0x39/0x1b0 [ 1648.733794] [] vfs_kern_mount+0x67/0x110 [ 1648.735938] [] do_mount+0x1ef/0xce0 [ 1648.738056] [] ? copy_mount_options+0x39/0x1b0 [ 1648.742609] [] SyS_mount+0x83/0xd0 [ 1648.747480] [] system_call_fastpath+0x1f/0x24 [ 1648.759980] LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5 [ 1648.763916] BUG: scheduling while atomic: mount.lustre/22893/0x10000002 [ 1648.769337] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1648.800303] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1648.804715] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1648.807555] Call Trace: [ 1648.808380] [] dump_stack+0x19/0x1b [ 1648.810085] [] __schedule_bug+0x64/0x72 [ 1648.812395] [] __schedule+0x791/0x7d0 [ 1648.814426] [] ? ldiskfs_alloc_inode+0x1b/0x200 [ldiskfs] [ 1648.816517] [] __cond_resched+0x26/0x30 [ 1648.818472] [] _cond_resched+0x3a/0x50 [ 1648.821304] [] kmem_cache_alloc+0x54/0x2e0 [ 1648.823525] [] ? do_raw_spin_unlock+0x49/0x90 [ 1648.826068] [] ldiskfs_alloc_inode+0x1b/0x200 [ldiskfs] [ 1648.828510] [] alloc_inode+0x1d/0xa0 [ 1648.830078] [] iget_locked+0xf8/0x1c0 [ 1648.832433] [] ldiskfs_iget+0x42/0xc60 [ldiskfs] [ 1648.835807] [] ? vprintk_emit+0x3e4/0x560 [ 1648.839101] [] ldiskfs_load_journal+0x19e/0x71c [ldiskfs] [ 1648.842511] [] ? printk+0x5d/0x74 [ 1648.845206] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1648.850028] [] mount_bdev+0x1b0/0x1f0 [ 1648.854037] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1648.857310] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1648.861026] [] mount_fs+0x39/0x1b0 [ 1648.864069] [] vfs_kern_mount+0x67/0x110 [ 1648.866645] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1648.868868] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1648.873418] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1648.875759] [] obd_setup+0x167/0x540 [obdclass] [ 1648.877508] [] class_setup+0x54f/0x830 [obdclass] [ 1648.879591] [] class_process_config+0x149b/0x2660 [obdclass] [ 1648.883928] [] ? __kmalloc+0x1e0/0x340 [ 1648.889421] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1648.895285] [] do_lcfg+0x263/0x520 [obdclass] [ 1648.898582] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1648.903803] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1648.908180] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1648.919134] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1648.921531] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1648.926896] [] mount_nodev+0x4d/0xb0 [ 1648.931807] [] lustre_mount+0x18/0x20 [lustre] [ 1648.933903] [] mount_fs+0x39/0x1b0 [ 1648.939529] [] vfs_kern_mount+0x67/0x110 [ 1648.941693] [] do_mount+0x1ef/0xce0 [ 1648.943751] [] ? copy_mount_options+0x39/0x1b0 [ 1648.946492] [] SyS_mount+0x83/0xd0 [ 1648.951917] [] system_call_fastpath+0x1f/0x24 [ 1648.957064] BUG: scheduling while atomic: mount.lustre/22893/0x00000002 [ 1648.964549] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1648.993881] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1648.998768] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1649.003734] Call Trace: [ 1649.004590] [] dump_stack+0x19/0x1b [ 1649.009820] [] __schedule_bug+0x64/0x72 [ 1649.020686] [] __schedule+0x791/0x7d0 [ 1649.022471] [] ? bit_wait+0x50/0x50 [ 1649.026847] [] schedule+0x29/0x70 [ 1649.028984] [] schedule_timeout+0x209/0x290 [ 1649.031045] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1649.036012] [] ? kvm_clock_read+0x33/0x40 [ 1649.038489] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1649.045581] [] ? bit_wait+0x50/0x50 [ 1649.049870] [] io_schedule_timeout+0xad/0x130 [ 1649.054188] [] io_schedule+0x18/0x20 [ 1649.059097] [] bit_wait_io+0x11/0x50 [ 1649.063402] [] __wait_on_bit+0x65/0x90 [ 1649.065574] [] ? bit_wait+0x50/0x50 [ 1649.070988] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1649.074298] [] ? wake_bit_function+0x40/0x40 [ 1649.076400] [] __wait_on_buffer+0x2a/0x30 [ 1649.083907] [] __ldiskfs_get_inode_loc+0x1bd/0x400 [ldiskfs] [ 1649.089521] [] ldiskfs_iget+0x96/0xc60 [ldiskfs] [ 1649.092676] [] ? vprintk_emit+0x3e4/0x560 [ 1649.095514] [] ldiskfs_load_journal+0x19e/0x71c [ldiskfs] [ 1649.101062] [] ? printk+0x5d/0x74 [ 1649.106686] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1649.110277] [] mount_bdev+0x1b0/0x1f0 [ 1649.114416] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1649.118350] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1649.123221] [] mount_fs+0x39/0x1b0 [ 1649.125890] [] vfs_kern_mount+0x67/0x110 [ 1649.128883] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1649.132161] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1649.136373] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1649.141405] [] obd_setup+0x167/0x540 [obdclass] [ 1649.144378] [] class_setup+0x54f/0x830 [obdclass] [ 1649.148049] [] class_process_config+0x149b/0x2660 [obdclass] [ 1649.152884] [] ? __kmalloc+0x1e0/0x340 [ 1649.155882] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1649.158953] [] do_lcfg+0x263/0x520 [obdclass] [ 1649.163026] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1649.171710] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1649.182850] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1649.195759] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1649.199519] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1649.205621] [] mount_nodev+0x4d/0xb0 [ 1649.211608] [] lustre_mount+0x18/0x20 [lustre] [ 1649.218267] [] mount_fs+0x39/0x1b0 [ 1649.224860] [] vfs_kern_mount+0x67/0x110 [ 1649.230960] [] do_mount+0x1ef/0xce0 [ 1649.236582] [] ? copy_mount_options+0x39/0x1b0 [ 1649.241398] [] SyS_mount+0x83/0xd0 [ 1649.243385] [] system_call_fastpath+0x1f/0x24 [ 1649.246323] BUG: scheduling while atomic: mount.lustre/22893/0x00000002 [ 1649.249098] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1649.283217] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1649.289567] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1649.303780] Call Trace: [ 1649.306110] [] dump_stack+0x19/0x1b [ 1649.307800] [] __schedule_bug+0x64/0x72 [ 1649.309518] [] __schedule+0x791/0x7d0 [ 1649.311345] [] ? bit_wait+0x50/0x50 [ 1649.313263] [] schedule+0x29/0x70 [ 1649.314787] [] schedule_timeout+0x209/0x290 [ 1649.324352] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1649.328935] [] ? kvm_clock_read+0x33/0x40 [ 1649.333190] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1649.337893] [] ? bit_wait+0x50/0x50 [ 1649.344855] [] io_schedule_timeout+0xad/0x130 [ 1649.354605] [] io_schedule+0x18/0x20 [ 1649.356067] [] bit_wait_io+0x11/0x50 [ 1649.357474] [] __wait_on_bit+0x65/0x90 [ 1649.361514] [] ? bit_wait+0x50/0x50 [ 1649.363526] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1649.366500] [] ? wake_bit_function+0x40/0x40 [ 1649.369095] [] __wait_on_buffer+0x2a/0x30 [ 1649.370625] [] journal_get_superblock+0x2c8/0x3a0 [jbd2] [ 1649.372209] [] jbd2_journal_wipe+0x20/0xb0 [jbd2] [ 1649.374771] [] ldiskfs_load_journal+0x5c5/0x71c [ldiskfs] [ 1649.377992] [] ? printk+0x5d/0x74 [ 1649.381497] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1649.385592] [] mount_bdev+0x1b0/0x1f0 [ 1649.387435] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1649.390824] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1649.394407] [] mount_fs+0x39/0x1b0 [ 1649.396229] [] vfs_kern_mount+0x67/0x110 [ 1649.400312] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1649.402726] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1649.405830] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1649.409465] [] obd_setup+0x167/0x540 [obdclass] [ 1649.413485] [] class_setup+0x54f/0x830 [obdclass] [ 1649.418157] [] class_process_config+0x149b/0x2660 [obdclass] [ 1649.421480] [] ? __kmalloc+0x1e0/0x340 [ 1649.424218] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1649.427480] [] do_lcfg+0x263/0x520 [obdclass] [ 1649.430723] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1649.434313] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1649.437479] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1649.440909] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1649.443571] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1649.446780] [] mount_nodev+0x4d/0xb0 [ 1649.452445] [] lustre_mount+0x18/0x20 [lustre] [ 1649.457108] [] mount_fs+0x39/0x1b0 [ 1649.460439] [] vfs_kern_mount+0x67/0x110 [ 1649.465806] [] do_mount+0x1ef/0xce0 [ 1649.469302] [] ? copy_mount_options+0x39/0x1b0 [ 1649.473332] [] SyS_mount+0x83/0xd0 [ 1649.478015] [] system_call_fastpath+0x1f/0x24 [ 1649.481822] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1649.484435] in_atomic(): 1, irqs_disabled(): 0, pid: 22893, name: mount.lustre [ 1649.489400] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1649.495526] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1649.501548] Call Trace: [ 1649.503011] [] dump_stack+0x19/0x1b [ 1649.508256] [] __might_sleep+0xd9/0x100 [ 1649.512511] [] kmem_cache_alloc_trace+0x57/0x2e0 [ 1649.516258] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1649.520018] [] ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1649.523964] [] ? printk+0x5d/0x74 [ 1649.528860] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1649.532950] [] mount_bdev+0x1b0/0x1f0 [ 1649.536302] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1649.541187] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1649.544101] [] mount_fs+0x39/0x1b0 [ 1649.548244] [] vfs_kern_mount+0x67/0x110 [ 1649.552989] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1649.557816] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1649.560467] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1649.563279] [] obd_setup+0x167/0x540 [obdclass] [ 1649.567023] [] class_setup+0x54f/0x830 [obdclass] [ 1649.569370] [] class_process_config+0x149b/0x2660 [obdclass] [ 1649.571684] [] ? __kmalloc+0x1e0/0x340 [ 1649.573386] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1649.578050] [] do_lcfg+0x263/0x520 [obdclass] [ 1649.585936] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1649.591320] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1649.594627] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1649.597847] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1649.600882] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1649.605875] [] mount_nodev+0x4d/0xb0 [ 1649.608262] [] lustre_mount+0x18/0x20 [lustre] [ 1649.611028] [] mount_fs+0x39/0x1b0 [ 1649.614017] [] vfs_kern_mount+0x67/0x110 [ 1649.617090] [] do_mount+0x1ef/0xce0 [ 1649.619397] [] ? copy_mount_options+0x39/0x1b0 [ 1649.623691] [] SyS_mount+0x83/0xd0 [ 1649.625474] [] system_call_fastpath+0x1f/0x24 [ 1649.627596] BUG: scheduling while atomic: mount.lustre/22893/0x10000002 [ 1649.632722] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1649.674022] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1649.684615] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1649.694089] Call Trace: [ 1649.697232] [] dump_stack+0x19/0x1b [ 1649.700590] [] __schedule_bug+0x64/0x72 [ 1649.704496] [] __schedule+0x791/0x7d0 [ 1649.706831] [] __cond_resched+0x26/0x30 [ 1649.709941] [] _cond_resched+0x3a/0x50 [ 1649.712661] [] kmem_cache_alloc_trace+0x5c/0x2e0 [ 1649.717005] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1649.719143] [] ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1649.730166] [] ? printk+0x5d/0x74 [ 1649.743289] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1649.750651] [] mount_bdev+0x1b0/0x1f0 [ 1649.753557] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1649.756525] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1649.758782] [] mount_fs+0x39/0x1b0 [ 1649.761525] [] vfs_kern_mount+0x67/0x110 [ 1649.764288] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1649.770108] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1649.780188] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1649.784588] [] obd_setup+0x167/0x540 [obdclass] [ 1649.787780] [] class_setup+0x54f/0x830 [obdclass] [ 1649.793193] [] class_process_config+0x149b/0x2660 [obdclass] [ 1649.797869] [] ? __kmalloc+0x1e0/0x340 [ 1649.801256] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1649.804671] [] do_lcfg+0x263/0x520 [obdclass] [ 1649.809071] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1649.811778] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1649.815613] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1649.820386] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1649.823455] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1649.825692] [] mount_nodev+0x4d/0xb0 [ 1649.827724] [] lustre_mount+0x18/0x20 [lustre] [ 1649.830586] [] mount_fs+0x39/0x1b0 [ 1649.832417] [] vfs_kern_mount+0x67/0x110 [ 1649.834539] [] do_mount+0x1ef/0xce0 [ 1649.836549] [] ? copy_mount_options+0x39/0x1b0 [ 1649.838609] [] SyS_mount+0x83/0xd0 [ 1649.840122] [] system_call_fastpath+0x1f/0x24 [ 1649.843053] BUG: scheduling while atomic: mount.lustre/22893/0x00000002 [ 1649.845297] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1649.874475] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1649.877651] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1649.881093] Call Trace: [ 1649.882413] [] dump_stack+0x19/0x1b [ 1649.883831] [] __schedule_bug+0x64/0x72 [ 1649.885834] [] __schedule+0x791/0x7d0 [ 1649.888545] [] ? enqueue_entity+0x2ef/0xc30 [ 1649.890305] [] schedule+0x29/0x70 [ 1649.891524] [] schedule_timeout+0x209/0x290 [ 1649.893696] [] ? sched_clock_cpu+0xa5/0xe0 [ 1649.895543] [] ? check_preempt_curr+0x80/0xa0 [ 1649.898615] [] ? ttwu_do_wakeup+0x19/0xf0 [ 1649.903969] [] wait_for_completion+0xfc/0x140 [ 1649.906120] [] ? wake_up_state+0x20/0x20 [ 1649.908275] [] kthread_create_on_node+0xa8/0x140 [ 1649.911058] [] ? commit_timeout+0x10/0x10 [jbd2] [ 1649.913147] [] jbd2_journal_load+0x16b/0x2d0 [jbd2] [ 1649.915302] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1649.917129] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 1649.919920] [] ? printk+0x5d/0x74 [ 1649.921821] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1649.924122] [] mount_bdev+0x1b0/0x1f0 [ 1649.928167] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1649.936506] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1649.945048] [] mount_fs+0x39/0x1b0 [ 1649.958256] [] vfs_kern_mount+0x67/0x110 [ 1649.959924] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1649.961908] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1649.970123] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1649.977711] [] obd_setup+0x167/0x540 [obdclass] [ 1649.986262] [] class_setup+0x54f/0x830 [obdclass] [ 1649.990406] [] class_process_config+0x149b/0x2660 [obdclass] [ 1649.994234] [] ? __kmalloc+0x1e0/0x340 [ 1649.997555] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1650.001952] [] do_lcfg+0x263/0x520 [obdclass] [ 1650.005207] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1650.010341] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1650.013754] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1650.019445] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1650.025239] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1650.030059] [] mount_nodev+0x4d/0xb0 [ 1650.035110] [] lustre_mount+0x18/0x20 [lustre] [ 1650.041972] [] mount_fs+0x39/0x1b0 [ 1650.044808] [] vfs_kern_mount+0x67/0x110 [ 1650.046531] [] do_mount+0x1ef/0xce0 [ 1650.048296] [] ? copy_mount_options+0x39/0x1b0 [ 1650.055676] [] SyS_mount+0x83/0xd0 [ 1650.060312] [] system_call_fastpath+0x1f/0x24 [ 1650.063540] BUG: scheduling while atomic: mount.lustre/22893/0x00000002 [ 1650.072936] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1650.101530] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1650.105206] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1650.108060] Call Trace: [ 1650.109006] [] dump_stack+0x19/0x1b [ 1650.110850] [] __schedule_bug+0x64/0x72 [ 1650.112927] [] __schedule+0x791/0x7d0 [ 1650.115158] [] schedule+0x29/0x70 [ 1650.119871] [] jbd2_journal_load+0x215/0x2d0 [jbd2] [ 1650.122327] [] ? wake_up_atomic_t+0x30/0x30 [ 1650.125618] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 1650.129002] [] ? printk+0x5d/0x74 [ 1650.132322] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1650.134210] [] mount_bdev+0x1b0/0x1f0 [ 1650.138068] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1650.144971] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1650.148254] [] mount_fs+0x39/0x1b0 [ 1650.150064] [] vfs_kern_mount+0x67/0x110 [ 1650.151918] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1650.155978] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1650.160327] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1650.163551] [] obd_setup+0x167/0x540 [obdclass] [ 1650.168262] [] class_setup+0x54f/0x830 [obdclass] [ 1650.172270] [] class_process_config+0x149b/0x2660 [obdclass] [ 1650.175944] [] ? __kmalloc+0x1e0/0x340 [ 1650.179459] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1650.185613] [] do_lcfg+0x263/0x520 [obdclass] [ 1650.189641] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1650.193046] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1650.196572] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1650.201300] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1650.206229] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1650.210887] [] mount_nodev+0x4d/0xb0 [ 1650.216675] [] lustre_mount+0x18/0x20 [lustre] [ 1650.221650] [] mount_fs+0x39/0x1b0 [ 1650.224396] [] vfs_kern_mount+0x67/0x110 [ 1650.228936] [] do_mount+0x1ef/0xce0 [ 1650.234426] [] ? copy_mount_options+0x39/0x1b0 [ 1650.238836] [] SyS_mount+0x83/0xd0 [ 1650.244818] [] system_call_fastpath+0x1f/0x24 [ 1650.251111] BUG: scheduling while atomic: mount.lustre/22893/0x10000002 [ 1650.254647] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1650.304220] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1650.325338] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1650.332278] Call Trace: [ 1650.334163] [] dump_stack+0x19/0x1b [ 1650.339188] [] __schedule_bug+0x64/0x72 [ 1650.345030] [] __schedule+0x791/0x7d0 [ 1650.348059] [] __cond_resched+0x26/0x30 [ 1650.355621] [] _cond_resched+0x3a/0x50 [ 1650.362012] [] wait_for_completion+0x42/0x140 [ 1650.368972] [] ? do_raw_spin_unlock+0x49/0x90 [ 1650.384701] [] kthread_create_on_node+0xa8/0x140 [ 1650.390930] [] ? process_one_work+0x4a0/0x4a0 [ 1650.396341] [] __alloc_workqueue_key+0x336/0x480 [ 1650.400806] [] ? do_raw_spin_unlock+0x49/0x90 [ 1650.402981] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 1650.404824] [] mount_bdev+0x1b0/0x1f0 [ 1650.406900] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1650.415923] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1650.420939] [] mount_fs+0x39/0x1b0 [ 1650.422577] [] vfs_kern_mount+0x67/0x110 [ 1650.424649] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1650.427395] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1650.431437] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1650.433974] [] obd_setup+0x167/0x540 [obdclass] [ 1650.437805] [] class_setup+0x54f/0x830 [obdclass] [ 1650.443967] [] class_process_config+0x149b/0x2660 [obdclass] [ 1650.451344] [] ? __kmalloc+0x1e0/0x340 [ 1650.458083] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1650.460927] [] do_lcfg+0x263/0x520 [obdclass] [ 1650.464770] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1650.469033] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1650.472918] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1650.479234] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1650.483878] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1650.489211] [] mount_nodev+0x4d/0xb0 [ 1650.491230] [] lustre_mount+0x18/0x20 [lustre] [ 1650.493690] [] mount_fs+0x39/0x1b0 [ 1650.495687] [] vfs_kern_mount+0x67/0x110 [ 1650.498530] [] do_mount+0x1ef/0xce0 [ 1650.501851] [] ? copy_mount_options+0x39/0x1b0 [ 1650.504668] [] SyS_mount+0x83/0xd0 [ 1650.507909] [] system_call_fastpath+0x1f/0x24 [ 1650.510902] BUG: sleeping function called from invalid context at kernel/mutex.c:104 [ 1650.513591] in_atomic(): 1, irqs_disabled(): 0, pid: 22893, name: mount.lustre [ 1650.523398] LustreError: 15393:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1650.523400] LustreError: 15393:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 7 previous similar messages [ 1650.534380] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1650.537963] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1650.543919] Call Trace: [ 1650.544583] [] dump_stack+0x19/0x1b [ 1650.549193] [] __might_sleep+0xd9/0x100 [ 1650.555092] [] mutex_lock+0x20/0x40 [ 1650.560556] [] __alloc_workqueue_key+0x1bd/0x480 [ 1650.570706] [] ? do_raw_spin_unlock+0x49/0x90 [ 1650.576127] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 1650.581934] [] mount_bdev+0x1b0/0x1f0 [ 1650.588028] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1650.590703] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1650.593832] [] mount_fs+0x39/0x1b0 [ 1650.598781] [] vfs_kern_mount+0x67/0x110 [ 1650.602638] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1650.607752] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1650.611817] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1650.616043] [] obd_setup+0x167/0x540 [obdclass] [ 1650.623399] [] class_setup+0x54f/0x830 [obdclass] [ 1650.628334] [] class_process_config+0x149b/0x2660 [obdclass] [ 1650.634738] [] ? __kmalloc+0x1e0/0x340 [ 1650.642129] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1650.647573] [] do_lcfg+0x263/0x520 [obdclass] [ 1650.655930] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1650.665063] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1650.668044] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1650.669993] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1650.676809] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1650.680368] [] mount_nodev+0x4d/0xb0 [ 1650.682813] [] lustre_mount+0x18/0x20 [lustre] [ 1650.685774] [] mount_fs+0x39/0x1b0 [ 1650.692256] [] vfs_kern_mount+0x67/0x110 [ 1650.693702] [] do_mount+0x1ef/0xce0 [ 1650.699864] [] ? copy_mount_options+0x39/0x1b0 [ 1650.703521] [] SyS_mount+0x83/0xd0 [ 1650.706016] [] system_call_fastpath+0x1f/0x24 [ 1650.708802] BUG: scheduling while atomic: mount.lustre/22893/0x10000002 [ 1650.714630] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1650.756628] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1650.779851] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1650.782970] Call Trace: [ 1650.783559] [] dump_stack+0x19/0x1b [ 1650.785153] [] __schedule_bug+0x64/0x72 [ 1650.788346] [] __schedule+0x791/0x7d0 [ 1650.790786] [] __cond_resched+0x26/0x30 [ 1650.792781] [] _cond_resched+0x3a/0x50 [ 1650.799041] [] mutex_lock+0x25/0x40 [ 1650.805297] [] __alloc_workqueue_key+0x1bd/0x480 [ 1650.810827] [] ? do_raw_spin_unlock+0x49/0x90 [ 1650.812971] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 1650.815148] [] mount_bdev+0x1b0/0x1f0 [ 1650.819513] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1650.822259] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1650.826164] [] mount_fs+0x39/0x1b0 [ 1650.831291] [] vfs_kern_mount+0x67/0x110 [ 1650.835057] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1650.837403] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1650.840897] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1650.847414] [] obd_setup+0x167/0x540 [obdclass] [ 1650.851881] [] class_setup+0x54f/0x830 [obdclass] [ 1650.856425] [] class_process_config+0x149b/0x2660 [obdclass] [ 1650.859636] [] ? __kmalloc+0x1e0/0x340 [ 1650.864819] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1650.867203] [] do_lcfg+0x263/0x520 [obdclass] [ 1650.870278] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1650.874673] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1650.876437] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1650.878123] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1650.879812] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1650.881991] [] mount_nodev+0x4d/0xb0 [ 1650.883911] [] lustre_mount+0x18/0x20 [lustre] [ 1650.889333] [] mount_fs+0x39/0x1b0 [ 1650.894498] [] vfs_kern_mount+0x67/0x110 [ 1650.899118] [] do_mount+0x1ef/0xce0 [ 1650.904189] [] ? copy_mount_options+0x39/0x1b0 [ 1650.912230] [] SyS_mount+0x83/0xd0 [ 1650.916086] [] system_call_fastpath+0x1f/0x24 [ 1650.921092] BUG: scheduling while atomic: mount.lustre/22893/0x00000002 [ 1650.924147] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1650.967169] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1650.982375] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1650.997050] Call Trace: [ 1650.998175] [] dump_stack+0x19/0x1b [ 1651.002818] [] __schedule_bug+0x64/0x72 [ 1651.013669] [] __schedule+0x791/0x7d0 [ 1651.021886] [] ? bit_wait+0x50/0x50 [ 1651.025844] [] schedule+0x29/0x70 [ 1651.030630] [] schedule_timeout+0x209/0x290 [ 1651.036787] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1651.046947] [] ? kvm_clock_read+0x33/0x40 [ 1651.054232] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1651.057226] [] ? ktime_get_ts64+0x4c/0xf0 [ 1651.064045] [] ? bit_wait+0x50/0x50 [ 1651.075889] [] io_schedule_timeout+0xad/0x130 [ 1651.080943] [] io_schedule+0x18/0x20 [ 1651.084811] [] bit_wait_io+0x11/0x50 [ 1651.086437] [] __wait_on_bit+0x65/0x90 [ 1651.090265] [] ? bit_wait+0x50/0x50 [ 1651.098048] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1651.099971] [] ? wake_bit_function+0x40/0x40 [ 1651.101936] [] __sync_dirty_buffer+0xe8/0x110 [ 1651.108875] [] sync_dirty_buffer+0x13/0x20 [ 1651.116590] [] ldiskfs_commit_super+0x1e0/0x280 [ldiskfs] [ 1651.122645] [] ldiskfs_setup_super+0x120/0x190 [ldiskfs] [ 1651.129463] [] ldiskfs_fill_super+0x2429/0x3060 [ldiskfs] [ 1651.136559] [] mount_bdev+0x1b0/0x1f0 [ 1651.142835] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1651.151967] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1651.158885] [] mount_fs+0x39/0x1b0 [ 1651.163476] [] vfs_kern_mount+0x67/0x110 [ 1651.168703] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1651.172845] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1651.177184] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1651.182672] [] obd_setup+0x167/0x540 [obdclass] [ 1651.192061] [] class_setup+0x54f/0x830 [obdclass] [ 1651.200354] [] class_process_config+0x149b/0x2660 [obdclass] [ 1651.204697] [] ? __kmalloc+0x1e0/0x340 [ 1651.209085] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1651.211720] [] do_lcfg+0x263/0x520 [obdclass] [ 1651.215764] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1651.219274] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1651.225257] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1651.229044] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1651.231691] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1651.234712] [] mount_nodev+0x4d/0xb0 [ 1651.237054] [] lustre_mount+0x18/0x20 [lustre] [ 1651.239676] [] mount_fs+0x39/0x1b0 [ 1651.241917] [] vfs_kern_mount+0x67/0x110 [ 1651.244308] [] do_mount+0x1ef/0xce0 [ 1651.246226] [] ? copy_mount_options+0x39/0x1b0 [ 1651.249714] [] SyS_mount+0x83/0xd0 [ 1651.251314] [] system_call_fastpath+0x1f/0x24 [ 1651.255427] BUG: scheduling while atomic: mount.lustre/22893/0x00000002 [ 1651.257677] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1651.286733] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1651.293019] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1651.296323] Call Trace: [ 1651.298287] [] dump_stack+0x19/0x1b [ 1651.300926] [] __schedule_bug+0x64/0x72 [ 1651.303920] [] __schedule+0x791/0x7d0 [ 1651.307178] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1651.310044] [] ? bit_wait+0x50/0x50 [ 1651.311634] [] schedule+0x29/0x70 [ 1651.314997] [] schedule_timeout+0x209/0x290 [ 1651.317857] [] ? kvm_clock_read+0x33/0x40 [ 1651.321109] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1651.324216] [] ? ktime_get_ts64+0x4c/0xf0 [ 1651.328419] [] ? bit_wait+0x50/0x50 [ 1651.331225] [] io_schedule_timeout+0xad/0x130 [ 1651.335005] [] io_schedule+0x18/0x20 [ 1651.337520] [] bit_wait_io+0x11/0x50 [ 1651.340250] [] __wait_on_bit+0x65/0x90 [ 1651.345292] [] ? bit_wait+0x50/0x50 [ 1651.350238] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1651.360761] [] ? wake_bit_function+0x40/0x40 [ 1651.362439] [] __wait_on_buffer+0x2a/0x30 [ 1651.376314] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1651.386789] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1651.398714] [] v2_read_header+0x1f/0x50 [ 1651.405225] [] v2_check_quota_file+0x2b/0x70 [ 1651.411855] [] ? igrab+0x36/0x60 [ 1651.417612] [] vfs_load_quota_inode+0x279/0x570 [ 1651.423340] [] ? unlock_new_inode+0x55/0x80 [ 1651.425140] [] dquot_enable+0xf0/0x110 [ 1651.430932] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1651.433487] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1651.436091] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1651.438617] [] mount_bdev+0x1b0/0x1f0 [ 1651.441244] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1651.447348] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1651.448896] [] mount_fs+0x39/0x1b0 [ 1651.450125] [] vfs_kern_mount+0x67/0x110 [ 1651.458588] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1651.463303] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1651.473217] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1651.479541] [] obd_setup+0x167/0x540 [obdclass] [ 1651.483012] [] class_setup+0x54f/0x830 [obdclass] [ 1651.486397] [] class_process_config+0x149b/0x2660 [obdclass] [ 1651.489135] [] ? __kmalloc+0x1e0/0x340 [ 1651.500914] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1651.504565] [] do_lcfg+0x263/0x520 [obdclass] [ 1651.507873] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1651.510379] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1651.512444] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1651.515651] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1651.518697] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1651.521969] [] mount_nodev+0x4d/0xb0 [ 1651.524473] [] lustre_mount+0x18/0x20 [lustre] [ 1651.527415] [] mount_fs+0x39/0x1b0 [ 1651.529154] [] vfs_kern_mount+0x67/0x110 [ 1651.532817] [] do_mount+0x1ef/0xce0 [ 1651.534480] [] ? copy_mount_options+0x39/0x1b0 [ 1651.536352] [] SyS_mount+0x83/0xd0 [ 1651.543246] [] system_call_fastpath+0x1f/0x24 [ 1651.548547] BUG: sleeping function called from invalid context at kernel/mutex.c:104 [ 1651.550894] in_atomic(): 1, irqs_disabled(): 0, pid: 22893, name: mount.lustre [ 1651.554556] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1651.560208] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1651.563859] Call Trace: [ 1651.566821] [] dump_stack+0x19/0x1b [ 1651.569421] [] __might_sleep+0xd9/0x100 [ 1651.578109] [] mutex_lock+0x20/0x40 [ 1651.580054] [] vfs_load_quota_inode+0x2d8/0x570 [ 1651.582833] [] dquot_enable+0xf0/0x110 [ 1651.587364] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1651.590589] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1651.593558] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1651.598283] [] mount_bdev+0x1b0/0x1f0 [ 1651.601052] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1651.605335] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1651.607882] [] mount_fs+0x39/0x1b0 [ 1651.609371] [] vfs_kern_mount+0x67/0x110 [ 1651.611032] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1651.613437] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1651.616251] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1651.620120] [] obd_setup+0x167/0x540 [obdclass] [ 1651.624071] [] class_setup+0x54f/0x830 [obdclass] [ 1651.631708] [] class_process_config+0x149b/0x2660 [obdclass] [ 1651.644080] [] ? __kmalloc+0x1e0/0x340 [ 1651.646714] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1651.651339] [] do_lcfg+0x263/0x520 [obdclass] [ 1651.657674] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1651.659663] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1651.661691] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1651.670902] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1651.674866] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1651.685003] [] mount_nodev+0x4d/0xb0 [ 1651.688195] [] lustre_mount+0x18/0x20 [lustre] [ 1651.693380] [] mount_fs+0x39/0x1b0 [ 1651.695839] [] vfs_kern_mount+0x67/0x110 [ 1651.700065] [] do_mount+0x1ef/0xce0 [ 1651.702260] [] ? copy_mount_options+0x39/0x1b0 [ 1651.705694] [] SyS_mount+0x83/0xd0 [ 1651.708001] [] system_call_fastpath+0x1f/0x24 [ 1651.711708] BUG: scheduling while atomic: mount.lustre/22893/0x10000002 [ 1651.713662] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1651.775874] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1651.786817] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1651.794223] Call Trace: [ 1651.798919] [] dump_stack+0x19/0x1b [ 1651.804977] [] __schedule_bug+0x64/0x72 [ 1651.810692] [] __schedule+0x791/0x7d0 [ 1651.816280] [] __cond_resched+0x26/0x30 [ 1651.825673] [] _cond_resched+0x3a/0x50 [ 1651.830430] [] mutex_lock+0x25/0x40 [ 1651.835042] [] vfs_load_quota_inode+0x2d8/0x570 [ 1651.840897] [] dquot_enable+0xf0/0x110 [ 1651.845020] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1651.850000] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1651.853431] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1651.858127] [] mount_bdev+0x1b0/0x1f0 [ 1651.862081] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1651.870318] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1651.883027] [] mount_fs+0x39/0x1b0 [ 1651.887801] [] vfs_kern_mount+0x67/0x110 [ 1651.894144] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1651.899388] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1651.904384] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1651.913630] [] obd_setup+0x167/0x540 [obdclass] [ 1651.918660] [] class_setup+0x54f/0x830 [obdclass] [ 1651.923483] [] class_process_config+0x149b/0x2660 [obdclass] [ 1651.927475] [] ? __kmalloc+0x1e0/0x340 [ 1651.932014] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1651.939153] [] do_lcfg+0x263/0x520 [obdclass] [ 1651.947252] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1651.954772] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1651.960497] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1651.965719] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1651.967866] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1651.970173] [] mount_nodev+0x4d/0xb0 [ 1651.974357] [] lustre_mount+0x18/0x20 [lustre] [ 1651.982216] [] mount_fs+0x39/0x1b0 [ 1651.991541] [] vfs_kern_mount+0x67/0x110 [ 1651.999908] [] do_mount+0x1ef/0xce0 [ 1652.004253] [] ? copy_mount_options+0x39/0x1b0 [ 1652.014356] [] SyS_mount+0x83/0xd0 [ 1652.020724] [] system_call_fastpath+0x1f/0x24 [ 1652.030053] BUG: scheduling while atomic: mount.lustre/22893/0x00000002 [ 1652.032760] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1652.110390] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1652.115912] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1652.121782] Call Trace: [ 1652.122621] [] dump_stack+0x19/0x1b [ 1652.125485] [] __schedule_bug+0x64/0x72 [ 1652.127550] [] __schedule+0x791/0x7d0 [ 1652.133298] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1652.136971] [] ? bit_wait+0x50/0x50 [ 1652.144659] [] schedule+0x29/0x70 [ 1652.146412] [] schedule_timeout+0x209/0x290 [ 1652.149205] [] ? kvm_clock_read+0x33/0x40 [ 1652.151451] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1652.154670] [] ? ktime_get_ts64+0x4c/0xf0 [ 1652.159959] [] ? bit_wait+0x50/0x50 [ 1652.163334] [] io_schedule_timeout+0xad/0x130 [ 1652.167194] [] io_schedule+0x18/0x20 [ 1652.169083] [] bit_wait_io+0x11/0x50 [ 1652.171498] [] __wait_on_bit+0x65/0x90 [ 1652.173824] [] ? bit_wait+0x50/0x50 [ 1652.175792] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1652.178333] [] ? wake_bit_function+0x40/0x40 [ 1652.181479] [] __wait_on_buffer+0x2a/0x30 [ 1652.185392] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1652.188666] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1652.193237] [] v2_read_header+0x1f/0x50 [ 1652.195768] [] v2_check_quota_file+0x2b/0x70 [ 1652.199656] [] ? igrab+0x36/0x60 [ 1652.201791] [] vfs_load_quota_inode+0x279/0x570 [ 1652.208180] [] ? unlock_new_inode+0x55/0x80 [ 1652.212000] [] dquot_enable+0xf0/0x110 [ 1652.215104] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1652.218654] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1652.221886] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1652.224822] [] mount_bdev+0x1b0/0x1f0 [ 1652.226586] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1652.231526] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1652.236336] [] mount_fs+0x39/0x1b0 [ 1652.238936] [] vfs_kern_mount+0x67/0x110 [ 1652.244108] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1652.249708] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1652.255517] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1652.262193] [] obd_setup+0x167/0x540 [obdclass] [ 1652.266075] [] class_setup+0x54f/0x830 [obdclass] [ 1652.268815] [] class_process_config+0x149b/0x2660 [obdclass] [ 1652.273897] [] ? __kmalloc+0x1e0/0x340 [ 1652.278147] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1652.282406] [] do_lcfg+0x263/0x520 [obdclass] [ 1652.288244] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1652.292038] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1652.296394] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1652.300948] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1652.305965] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1652.309025] [] mount_nodev+0x4d/0xb0 [ 1652.312217] [] lustre_mount+0x18/0x20 [lustre] [ 1652.315420] [] mount_fs+0x39/0x1b0 [ 1652.317619] [] vfs_kern_mount+0x67/0x110 [ 1652.320200] [] do_mount+0x1ef/0xce0 [ 1652.322064] [] ? copy_mount_options+0x39/0x1b0 [ 1652.326815] [] SyS_mount+0x83/0xd0 [ 1652.328959] [] system_call_fastpath+0x1f/0x24 [ 1652.333074] BUG: scheduling while atomic: mount.lustre/22893/0x00000002 [ 1652.336126] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1652.365538] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1652.369690] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1652.373310] Call Trace: [ 1652.374471] [] dump_stack+0x19/0x1b [ 1652.377439] [] __schedule_bug+0x64/0x72 [ 1652.380205] [] __schedule+0x791/0x7d0 [ 1652.385095] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1652.387186] [] ? bit_wait+0x50/0x50 [ 1652.388581] [] schedule+0x29/0x70 [ 1652.390469] [] schedule_timeout+0x209/0x290 [ 1652.391959] [] ? kvm_clock_read+0x33/0x40 [ 1652.399429] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1652.404144] [] ? ktime_get_ts64+0x4c/0xf0 [ 1652.409796] [] ? bit_wait+0x50/0x50 [ 1652.411483] [] io_schedule_timeout+0xad/0x130 [ 1652.417412] [] io_schedule+0x18/0x20 [ 1652.422380] [] bit_wait_io+0x11/0x50 [ 1652.429513] [] __wait_on_bit+0x65/0x90 [ 1652.434770] [] ? bit_wait+0x50/0x50 [ 1652.448461] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1652.451708] [] ? wake_bit_function+0x40/0x40 [ 1652.456393] [] __wait_on_buffer+0x2a/0x30 [ 1652.458469] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1652.472272] [] ? mark_page_accessed+0xd8/0xe0 [ 1652.480019] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1652.487429] [] v2_read_header+0x1f/0x50 [ 1652.492709] [] v2_check_quota_file+0x2b/0x70 [ 1652.497012] [] ? igrab+0x36/0x60 [ 1652.499016] [] vfs_load_quota_inode+0x279/0x570 [ 1652.509676] [] ? unlock_new_inode+0x55/0x80 [ 1652.511822] [] dquot_enable+0xf0/0x110 [ 1652.523774] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1652.528970] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1652.531304] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1652.535681] [] mount_bdev+0x1b0/0x1f0 [ 1652.539671] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1652.547874] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1652.551461] [] mount_fs+0x39/0x1b0 [ 1652.557362] [] vfs_kern_mount+0x67/0x110 [ 1652.559427] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1652.566259] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1652.573842] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1652.584332] [] obd_setup+0x167/0x540 [obdclass] [ 1652.586862] [] class_setup+0x54f/0x830 [obdclass] [ 1652.600843] [] class_process_config+0x149b/0x2660 [obdclass] [ 1652.606648] [] ? __kmalloc+0x1e0/0x340 [ 1652.608632] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1652.615352] [] do_lcfg+0x263/0x520 [obdclass] [ 1652.621751] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1652.625976] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1652.629936] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1652.633284] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1652.636096] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1652.639282] [] mount_nodev+0x4d/0xb0 [ 1652.643125] [] lustre_mount+0x18/0x20 [lustre] [ 1652.651090] [] mount_fs+0x39/0x1b0 [ 1652.656674] [] vfs_kern_mount+0x67/0x110 [ 1652.661680] [] do_mount+0x1ef/0xce0 [ 1652.667028] [] ? copy_mount_options+0x39/0x1b0 [ 1652.675234] [] SyS_mount+0x83/0xd0 [ 1652.681807] [] system_call_fastpath+0x1f/0x24 [ 1652.685712] BUG: sleeping function called from invalid context at kernel/mutex.c:104 [ 1652.688808] in_atomic(): 1, irqs_disabled(): 0, pid: 22893, name: mount.lustre [ 1652.695388] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1652.702053] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1652.705120] Call Trace: [ 1652.706144] [] dump_stack+0x19/0x1b [ 1652.708117] [] __might_sleep+0xd9/0x100 [ 1652.713054] [] mutex_lock+0x20/0x40 [ 1652.722803] [] vfs_load_quota_inode+0x2d8/0x570 [ 1652.727737] [] dquot_enable+0xf0/0x110 [ 1652.735993] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1652.741288] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1652.745950] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1652.751555] [] mount_bdev+0x1b0/0x1f0 [ 1652.756400] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1652.764234] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1652.772864] [] mount_fs+0x39/0x1b0 [ 1652.780496] [] vfs_kern_mount+0x67/0x110 [ 1652.788758] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1652.794682] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1652.797964] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1652.801354] [] obd_setup+0x167/0x540 [obdclass] [ 1652.804042] [] class_setup+0x54f/0x830 [obdclass] [ 1652.807633] [] class_process_config+0x149b/0x2660 [obdclass] [ 1652.811819] [] ? __kmalloc+0x1e0/0x340 [ 1652.813922] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1652.818177] [] do_lcfg+0x263/0x520 [obdclass] [ 1652.820645] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1652.823638] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1652.826238] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1652.829039] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1652.831524] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1652.834158] [] mount_nodev+0x4d/0xb0 [ 1652.837105] [] lustre_mount+0x18/0x20 [lustre] [ 1652.840040] [] mount_fs+0x39/0x1b0 [ 1652.846601] [] vfs_kern_mount+0x67/0x110 [ 1652.851900] [] do_mount+0x1ef/0xce0 [ 1652.853633] [] ? copy_mount_options+0x39/0x1b0 [ 1652.857949] [] SyS_mount+0x83/0xd0 [ 1652.861896] [] system_call_fastpath+0x1f/0x24 [ 1652.867283] BUG: scheduling while atomic: mount.lustre/22893/0x10000002 [ 1652.882112] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1652.946834] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1652.966042] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1652.976004] Call Trace: [ 1652.983224] [] dump_stack+0x19/0x1b [ 1652.990184] [] __schedule_bug+0x64/0x72 [ 1652.997678] [] __schedule+0x791/0x7d0 [ 1653.004130] [] __cond_resched+0x26/0x30 [ 1653.010672] [] _cond_resched+0x3a/0x50 [ 1653.016226] [] mutex_lock+0x25/0x40 [ 1653.021149] [] vfs_load_quota_inode+0x2d8/0x570 [ 1653.026924] [] dquot_enable+0xf0/0x110 [ 1653.031246] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1653.046098] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1653.057056] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1653.060900] [] mount_bdev+0x1b0/0x1f0 [ 1653.068204] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1653.079530] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1653.090592] [] mount_fs+0x39/0x1b0 [ 1653.092600] [] vfs_kern_mount+0x67/0x110 [ 1653.094673] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1653.097051] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1653.099564] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1653.105922] [] obd_setup+0x167/0x540 [obdclass] [ 1653.110326] [] class_setup+0x54f/0x830 [obdclass] [ 1653.115002] [] class_process_config+0x149b/0x2660 [obdclass] [ 1653.121078] [] ? __kmalloc+0x1e0/0x340 [ 1653.126116] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1653.129281] [] do_lcfg+0x263/0x520 [obdclass] [ 1653.133748] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1653.137665] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1653.140559] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1653.144530] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1653.148223] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1653.151525] [] mount_nodev+0x4d/0xb0 [ 1653.155725] [] lustre_mount+0x18/0x20 [lustre] [ 1653.158708] [] mount_fs+0x39/0x1b0 [ 1653.161861] [] vfs_kern_mount+0x67/0x110 [ 1653.165312] [] do_mount+0x1ef/0xce0 [ 1653.168278] [] ? copy_mount_options+0x39/0x1b0 [ 1653.171048] [] SyS_mount+0x83/0xd0 [ 1653.173521] [] system_call_fastpath+0x1f/0x24 [ 1653.178019] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1653.182880] BUG: scheduling while atomic: mount.lustre/22893/0x10000002 [ 1653.187603] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1653.212942] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1653.219753] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1653.228001] Call Trace: [ 1653.230934] [] dump_stack+0x19/0x1b [ 1653.232893] [] __schedule_bug+0x64/0x72 [ 1653.237972] [] __schedule+0x791/0x7d0 [ 1653.241818] [] ? dquot_alloc+0x1a/0x20 [ 1653.246151] [] __cond_resched+0x26/0x30 [ 1653.250593] [] _cond_resched+0x3a/0x50 [ 1653.254225] [] kmem_cache_alloc+0x54/0x2e0 [ 1653.257828] [] ? cfs_trace_unlock_tcd+0x27/0x70 [libcfs] [ 1653.263024] [] ? libcfs_debug_msg+0x4c9/0xc60 [libcfs] [ 1653.267164] [] dquot_alloc+0x1a/0x20 [ 1653.271511] [] dqget+0x242/0x460 [ 1653.274196] [] __dquot_initialize+0x12d/0x230 [ 1653.277208] [] ? free_pages.part.76+0x40/0x50 [ 1653.281255] [] dquot_initialize+0x13/0x20 [ 1653.283891] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1653.287996] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1653.290787] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1653.294959] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1653.298899] [] obd_setup+0x167/0x540 [obdclass] [ 1653.303118] [] class_setup+0x54f/0x830 [obdclass] [ 1653.306052] [] class_process_config+0x149b/0x2660 [obdclass] [ 1653.310480] [] ? __kmalloc+0x1e0/0x340 [ 1653.313162] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1653.317492] [] do_lcfg+0x263/0x520 [obdclass] [ 1653.320415] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1653.323453] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1653.327629] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1653.330602] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1653.333055] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1653.335305] [] mount_nodev+0x4d/0xb0 [ 1653.337253] [] lustre_mount+0x18/0x20 [lustre] [ 1653.339240] [] mount_fs+0x39/0x1b0 [ 1653.340751] [] vfs_kern_mount+0x67/0x110 [ 1653.342405] [] do_mount+0x1ef/0xce0 [ 1653.343950] [] ? copy_mount_options+0x39/0x1b0 [ 1653.348427] [] SyS_mount+0x83/0xd0 [ 1653.352339] [] system_call_fastpath+0x1f/0x24 [ 1653.360692] BUG: scheduling while atomic: mount.lustre/22893/0x10000002 [ 1653.363441] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1653.394781] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1653.400077] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1653.407401] Call Trace: [ 1653.408307] [] dump_stack+0x19/0x1b [ 1653.411486] [] __schedule_bug+0x64/0x72 [ 1653.414162] [] __schedule+0x791/0x7d0 [ 1653.417981] [] __cond_resched+0x26/0x30 [ 1653.421128] [] _cond_resched+0x3a/0x50 [ 1653.423525] [] ldiskfs_bread+0x8f/0xe0 [ldiskfs] [ 1653.426510] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1653.435436] [] read_blk+0x4c/0x60 [ 1653.440212] [] find_tree_dqentry+0x47/0x240 [ 1653.444269] [] find_tree_dqentry+0x1aa/0x240 [ 1653.448032] [] find_tree_dqentry+0x1aa/0x240 [ 1653.453246] [] find_tree_dqentry+0x1aa/0x240 [ 1653.467087] [] qtree_read_dquot+0x14c/0x380 [ 1653.473064] [] v2_read_dquot+0x2b/0x30 [ 1653.475025] [] dquot_acquire+0xe4/0x130 [ 1653.477298] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1653.484720] [] dqget+0x3fb/0x460 [ 1653.487806] [] __dquot_initialize+0x12d/0x230 [ 1653.490131] [] dquot_initialize+0x13/0x20 [ 1653.493488] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1653.496375] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1653.498965] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1653.501708] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1653.504270] [] obd_setup+0x167/0x540 [obdclass] [ 1653.506490] [] class_setup+0x54f/0x830 [obdclass] [ 1653.511859] [] class_process_config+0x149b/0x2660 [obdclass] [ 1653.515312] [] ? __kmalloc+0x1e0/0x340 [ 1653.519035] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1653.521213] [] do_lcfg+0x263/0x520 [obdclass] [ 1653.527999] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1653.536024] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1653.538483] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1653.543222] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1653.547347] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1653.550316] [] mount_nodev+0x4d/0xb0 [ 1653.553237] [] lustre_mount+0x18/0x20 [lustre] [ 1653.560393] [] mount_fs+0x39/0x1b0 [ 1653.568676] [] vfs_kern_mount+0x67/0x110 [ 1653.572660] [] do_mount+0x1ef/0xce0 [ 1653.579499] [] ? copy_mount_options+0x39/0x1b0 [ 1653.587761] [] SyS_mount+0x83/0xd0 [ 1653.589985] [] system_call_fastpath+0x1f/0x24 [ 1653.596558] BUG: scheduling while atomic: mount.lustre/22893/0x00000002 [ 1653.598544] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1653.624927] CPU: 0 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1653.630154] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1653.638228] Call Trace: [ 1653.641173] [] dump_stack+0x19/0x1b [ 1653.643959] [] __schedule_bug+0x64/0x72 [ 1653.647723] [] __schedule+0x791/0x7d0 [ 1653.653288] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1653.657359] [] ? bit_wait+0x50/0x50 [ 1653.659449] [] schedule+0x29/0x70 [ 1653.660557] [] schedule_timeout+0x209/0x290 [ 1653.664515] [] ? kvm_clock_read+0x33/0x40 [ 1653.666891] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1653.674902] [] ? ktime_get_ts64+0x4c/0xf0 [ 1653.683467] [] ? bit_wait+0x50/0x50 [ 1653.689073] [] io_schedule_timeout+0xad/0x130 [ 1653.695443] [] io_schedule+0x18/0x20 [ 1653.703157] [] bit_wait_io+0x11/0x50 [ 1653.711907] [] __wait_on_bit+0x65/0x90 [ 1653.716142] [] ? bit_wait+0x50/0x50 [ 1653.718424] LustreError: 15638:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1653.718426] LustreError: 15638:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 1 previous similar message [ 1653.744639] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1653.756174] [] ? wake_bit_function+0x40/0x40 [ 1653.763213] [] __wait_on_buffer+0x2a/0x30 [ 1653.768516] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1653.773581] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1653.790023] [] read_blk+0x4c/0x60 [ 1653.792106] [] find_tree_dqentry+0x47/0x240 [ 1653.794273] [] find_tree_dqentry+0x1aa/0x240 [ 1653.796422] [] find_tree_dqentry+0x1aa/0x240 [ 1653.798532] [] find_tree_dqentry+0x1aa/0x240 [ 1653.800690] [] qtree_read_dquot+0x14c/0x380 [ 1653.802759] [] v2_read_dquot+0x2b/0x30 [ 1653.804413] [] dquot_acquire+0xe4/0x130 [ 1653.806121] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1653.814634] [] dqget+0x3fb/0x460 [ 1653.818891] [] __dquot_initialize+0x12d/0x230 [ 1653.823455] [] dquot_initialize+0x13/0x20 [ 1653.827131] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1653.845761] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1653.852099] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1653.855283] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1653.859171] [] obd_setup+0x167/0x540 [obdclass] [ 1653.866350] [] class_setup+0x54f/0x830 [obdclass] [ 1653.868858] [] class_process_config+0x149b/0x2660 [obdclass] [ 1653.871821] [] ? __kmalloc+0x1e0/0x340 [ 1653.875235] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1653.879554] [] do_lcfg+0x263/0x520 [obdclass] [ 1653.882225] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1653.890121] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1653.893847] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1653.897622] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1653.901916] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1653.907495] [] mount_nodev+0x4d/0xb0 [ 1653.909110] [] lustre_mount+0x18/0x20 [lustre] [ 1653.911111] [] mount_fs+0x39/0x1b0 [ 1653.913941] [] vfs_kern_mount+0x67/0x110 [ 1653.916003] [] do_mount+0x1ef/0xce0 [ 1653.918347] [] ? copy_mount_options+0x39/0x1b0 [ 1653.920687] [] SyS_mount+0x83/0xd0 [ 1653.922698] [] system_call_fastpath+0x1f/0x24 [ 1653.925827] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1653.927840] in_atomic(): 1, irqs_disabled(): 0, pid: 22893, name: mount.lustre [ 1653.935017] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1653.940447] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1653.943482] Call Trace: [ 1653.944512] [] dump_stack+0x19/0x1b [ 1653.947861] [] __might_sleep+0xd9/0x100 [ 1653.949759] [] __kmalloc+0x73/0x340 [ 1653.954579] [] ? getdqbuf+0x14/0x40 [ 1653.960653] [] getdqbuf+0x14/0x40 [ 1653.962595] [] find_tree_dqentry+0xaf/0x240 [ 1653.966431] [] find_tree_dqentry+0x1aa/0x240 [ 1653.970197] [] find_tree_dqentry+0x1aa/0x240 [ 1653.973009] [] find_tree_dqentry+0x1aa/0x240 [ 1653.976537] [] qtree_read_dquot+0x14c/0x380 [ 1653.978956] [] v2_read_dquot+0x2b/0x30 [ 1653.980444] [] dquot_acquire+0xe4/0x130 [ 1653.982075] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1653.984590] [] dqget+0x3fb/0x460 [ 1653.986411] [] __dquot_initialize+0x12d/0x230 [ 1653.993681] [] dquot_initialize+0x13/0x20 [ 1653.998116] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1654.001887] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1654.004116] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1654.008366] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1654.010349] [] obd_setup+0x167/0x540 [obdclass] [ 1654.013438] [] class_setup+0x54f/0x830 [obdclass] [ 1654.016922] [] class_process_config+0x149b/0x2660 [obdclass] [ 1654.028565] [] ? __kmalloc+0x1e0/0x340 [ 1654.032025] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1654.035878] [] do_lcfg+0x263/0x520 [obdclass] [ 1654.039037] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1654.043090] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1654.046703] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1654.048602] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1654.050879] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1654.052987] [] mount_nodev+0x4d/0xb0 [ 1654.054958] [] lustre_mount+0x18/0x20 [lustre] [ 1654.059368] [] mount_fs+0x39/0x1b0 [ 1654.063163] [] vfs_kern_mount+0x67/0x110 [ 1654.067430] [] do_mount+0x1ef/0xce0 [ 1654.071117] [] ? copy_mount_options+0x39/0x1b0 [ 1654.074816] [] SyS_mount+0x83/0xd0 [ 1654.076991] [] system_call_fastpath+0x1f/0x24 [ 1654.082490] BUG: scheduling while atomic: mount.lustre/22893/0x10000002 [ 1654.086915] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1654.111831] CPU: 1 PID: 22893 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1654.115152] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1654.118172] Call Trace: [ 1654.119099] [] dump_stack+0x19/0x1b [ 1654.121422] [] __schedule_bug+0x64/0x72 [ 1654.123554] [] __schedule+0x791/0x7d0 [ 1654.125909] [] __cond_resched+0x26/0x30 [ 1654.128849] [] _cond_resched+0x3a/0x50 [ 1654.131540] [] __kmalloc+0x78/0x340 [ 1654.136652] [] ? getdqbuf+0x14/0x40 [ 1654.138986] [] getdqbuf+0x14/0x40 [ 1654.141363] [] find_tree_dqentry+0xaf/0x240 [ 1654.144619] [] find_tree_dqentry+0x1aa/0x240 [ 1654.147516] [] find_tree_dqentry+0x1aa/0x240 [ 1654.151849] [] find_tree_dqentry+0x1aa/0x240 [ 1654.154240] [] qtree_read_dquot+0x14c/0x380 [ 1654.159898] [] v2_read_dquot+0x2b/0x30 [ 1654.164605] [] dquot_acquire+0xe4/0x130 [ 1654.168517] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1654.174584] [] dqget+0x3fb/0x460 [ 1654.179897] [] __dquot_initialize+0x12d/0x230 [ 1654.181965] [] dquot_initialize+0x13/0x20 [ 1654.183610] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1654.186172] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1654.188252] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1654.190849] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1654.193180] [] obd_setup+0x167/0x540 [obdclass] [ 1654.198002] [] class_setup+0x54f/0x830 [obdclass] [ 1654.202054] [] class_process_config+0x149b/0x2660 [obdclass] [ 1654.206283] [] ? __kmalloc+0x1e0/0x340 [ 1654.210594] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1654.213050] [] do_lcfg+0x263/0x520 [obdclass] [ 1654.217455] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1654.220233] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1654.228311] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1654.230647] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1654.233295] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1654.236173] [] mount_nodev+0x4d/0xb0 [ 1654.238537] [] lustre_mount+0x18/0x20 [lustre] [ 1654.242606] [] mount_fs+0x39/0x1b0 [ 1654.244536] [] vfs_kern_mount+0x67/0x110 [ 1654.248104] [] do_mount+0x1ef/0xce0 [ 1654.251903] [] ? copy_mount_options+0x39/0x1b0 [ 1654.256388] [] SyS_mount+0x83/0xd0 [ 1654.259402] [] system_call_fastpath+0x1f/0x24 [ 1654.540716] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1654.560411] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1655.699211] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1655.899623] Lustre: lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. [ 1655.903181] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 192.168.204.113@tcp (at 0@lo) [ 1657.564858] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1661.714012] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1664.565029] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1666.899504] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1669.482257] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1671.908558] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1674.263187] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1687.232999] Lustre: Failing over lustre-OST0000 [ 1687.260822] LustreError: 26007:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1687.263341] LustreError: 26007:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1687.334735] Lustre: server umount lustre-OST0000 complete [ 1688.806052] LustreError: 12987:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1689.608388] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1689.617105] Lustre: Skipped 2 previous similar messages [ 1692.410815] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1692.416302] in_atomic(): 1, irqs_disabled(): 0, pid: 26604, name: mount.lustre [ 1692.423969] CPU: 2 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1692.431791] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1692.439710] Call Trace: [ 1692.440620] [] dump_stack+0x19/0x1b [ 1692.443966] [] __might_sleep+0xd9/0x100 [ 1692.445977] [] kmem_cache_alloc+0x4f/0x2e0 [ 1692.449284] [] alloc_vfsmnt+0x24/0x240 [ 1692.453422] [] vfs_kern_mount+0x36/0x110 [ 1692.457220] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1692.460414] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1692.464118] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1692.466774] [] obd_setup+0x167/0x540 [obdclass] [ 1692.468865] [] class_setup+0x54f/0x830 [obdclass] [ 1692.473246] [] class_process_config+0x149b/0x2660 [obdclass] [ 1692.475770] [] ? __kmalloc+0x1e0/0x340 [ 1692.477797] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1692.479806] [] do_lcfg+0x263/0x520 [obdclass] [ 1692.485523] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1692.488568] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1692.491161] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1692.496768] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1692.500186] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1692.502594] [] mount_nodev+0x4d/0xb0 [ 1692.504789] [] lustre_mount+0x18/0x20 [lustre] [ 1692.508410] [] mount_fs+0x39/0x1b0 [ 1692.510469] [] vfs_kern_mount+0x67/0x110 [ 1692.520440] [] do_mount+0x1ef/0xce0 [ 1692.526150] [] ? copy_mount_options+0x39/0x1b0 [ 1692.529673] [] SyS_mount+0x83/0xd0 [ 1692.531503] [] system_call_fastpath+0x1f/0x24 [ 1692.535019] BUG: scheduling while atomic: mount.lustre/26604/0x10000002 [ 1692.542317] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1692.577294] CPU: 2 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1692.583308] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1692.590811] Call Trace: [ 1692.591534] [] dump_stack+0x19/0x1b [ 1692.593192] [] __schedule_bug+0x64/0x72 [ 1692.595113] [] __schedule+0x791/0x7d0 [ 1692.596659] [] ? alloc_vfsmnt+0x24/0x240 [ 1692.604922] [] __cond_resched+0x26/0x30 [ 1692.608011] [] _cond_resched+0x3a/0x50 [ 1692.621573] [] kmem_cache_alloc+0x54/0x2e0 [ 1692.628237] [] alloc_vfsmnt+0x24/0x240 [ 1692.635287] [] vfs_kern_mount+0x36/0x110 [ 1692.638432] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1692.645200] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1692.648331] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1692.652090] [] obd_setup+0x167/0x540 [obdclass] [ 1692.656020] [] class_setup+0x54f/0x830 [obdclass] [ 1692.657832] [] class_process_config+0x149b/0x2660 [obdclass] [ 1692.660148] [] ? __kmalloc+0x1e0/0x340 [ 1692.661842] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1692.663634] [] do_lcfg+0x263/0x520 [obdclass] [ 1692.665803] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1692.668258] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1692.670615] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1692.672914] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1692.681629] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1692.687893] [] mount_nodev+0x4d/0xb0 [ 1692.691490] [] lustre_mount+0x18/0x20 [lustre] [ 1692.704275] [] mount_fs+0x39/0x1b0 [ 1692.716168] [] vfs_kern_mount+0x67/0x110 [ 1692.720709] [] do_mount+0x1ef/0xce0 [ 1692.725328] [] ? copy_mount_options+0x39/0x1b0 [ 1692.729270] [] SyS_mount+0x83/0xd0 [ 1692.741351] [] system_call_fastpath+0x1f/0x24 [ 1692.751818] BUG: scheduling while atomic: mount.lustre/26604/0x10000002 [ 1692.760742] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1692.828097] CPU: 3 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1692.837380] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1692.844597] Call Trace: [ 1692.848307] [] dump_stack+0x19/0x1b [ 1692.853394] [] __schedule_bug+0x64/0x72 [ 1692.858674] [] __schedule+0x791/0x7d0 [ 1692.861321] [] __cond_resched+0x26/0x30 [ 1692.865098] [] _cond_resched+0x3a/0x50 [ 1692.867307] [] truncate_inode_pages_range+0x237/0x7d0 [ 1692.871041] [] truncate_inode_pages+0x15/0x20 [ 1692.874313] [] kill_bdev+0x35/0x40 [ 1692.876945] [] set_blocksize+0xab/0xd0 [ 1692.880623] [] sb_set_blocksize+0x1d/0x50 [ 1692.883291] [] sb_min_blocksize+0x42/0x60 [ 1692.886778] [] ldiskfs_fill_super+0x1c2/0x3060 [ldiskfs] [ 1692.889554] [] ? snprintf+0x49/0x70 [ 1692.893016] [] mount_bdev+0x1b0/0x1f0 [ 1692.895691] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1692.899222] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1692.902791] [] mount_fs+0x39/0x1b0 [ 1692.904975] [] vfs_kern_mount+0x67/0x110 [ 1692.909950] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1692.912327] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1692.915574] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1692.918318] [] obd_setup+0x167/0x540 [obdclass] [ 1692.923154] [] class_setup+0x54f/0x830 [obdclass] [ 1692.929918] [] class_process_config+0x149b/0x2660 [obdclass] [ 1692.934505] [] ? __kmalloc+0x1e0/0x340 [ 1692.938087] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1692.942318] [] do_lcfg+0x263/0x520 [obdclass] [ 1692.947419] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1692.952719] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1692.958190] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1692.963126] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1692.965657] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1692.969118] [] mount_nodev+0x4d/0xb0 [ 1692.975742] [] lustre_mount+0x18/0x20 [lustre] [ 1692.979364] [] mount_fs+0x39/0x1b0 [ 1692.991382] [] vfs_kern_mount+0x67/0x110 [ 1692.998651] [] do_mount+0x1ef/0xce0 [ 1693.002122] [] ? copy_mount_options+0x39/0x1b0 [ 1693.009441] [] SyS_mount+0x83/0xd0 [ 1693.012664] [] system_call_fastpath+0x1f/0x24 [ 1693.018041] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1693.021389] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1693.064709] CPU: 0 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1693.071656] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1693.079406] Call Trace: [ 1693.081285] [] dump_stack+0x19/0x1b [ 1693.083905] [] __schedule_bug+0x64/0x72 [ 1693.087832] [] __schedule+0x791/0x7d0 [ 1693.091093] [] ? bit_wait+0x50/0x50 [ 1693.095653] [] schedule+0x29/0x70 [ 1693.099490] [] schedule_timeout+0x209/0x290 [ 1693.105552] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1693.119855] [] ? kvm_clock_read+0x33/0x40 [ 1693.123144] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1693.131454] [] ? ktime_get_ts64+0x4c/0xf0 [ 1693.139710] [] ? bit_wait+0x50/0x50 [ 1693.141230] [] io_schedule_timeout+0xad/0x130 [ 1693.150043] [] io_schedule+0x18/0x20 [ 1693.156458] [] bit_wait_io+0x11/0x50 [ 1693.159794] [] __wait_on_bit+0x65/0x90 [ 1693.161847] [] ? bit_wait+0x50/0x50 [ 1693.164176] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1693.166254] [] ? wake_bit_function+0x40/0x40 [ 1693.169095] [] __bread+0xad/0xf0 [ 1693.174916] [] ldiskfs_fill_super+0x8ff/0x3060 [ldiskfs] [ 1693.179526] [] mount_bdev+0x1b0/0x1f0 [ 1693.185098] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1693.192748] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1693.197240] [] mount_fs+0x39/0x1b0 [ 1693.200483] [] vfs_kern_mount+0x67/0x110 [ 1693.203131] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1693.206892] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1693.210709] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1693.217535] [] obd_setup+0x167/0x540 [obdclass] [ 1693.220112] [] class_setup+0x54f/0x830 [obdclass] [ 1693.223278] [] class_process_config+0x149b/0x2660 [obdclass] [ 1693.227117] [] ? __kmalloc+0x1e0/0x340 [ 1693.231592] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1693.237747] [] do_lcfg+0x263/0x520 [obdclass] [ 1693.246997] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1693.249598] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1693.252130] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1693.256017] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1693.258273] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1693.260971] [] mount_nodev+0x4d/0xb0 [ 1693.263190] [] lustre_mount+0x18/0x20 [lustre] [ 1693.270664] [] mount_fs+0x39/0x1b0 [ 1693.277453] [] vfs_kern_mount+0x67/0x110 [ 1693.282331] [] do_mount+0x1ef/0xce0 [ 1693.286009] [] ? copy_mount_options+0x39/0x1b0 [ 1693.288422] [] SyS_mount+0x83/0xd0 [ 1693.290360] [] system_call_fastpath+0x1f/0x24 [ 1693.292932] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1693.296513] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1693.323750] CPU: 1 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1693.329470] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1693.337689] Call Trace: [ 1693.340092] [] dump_stack+0x19/0x1b [ 1693.346560] [] __schedule_bug+0x64/0x72 [ 1693.350396] [] __schedule+0x791/0x7d0 [ 1693.356109] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1693.360314] [] ? bit_wait+0x50/0x50 [ 1693.364578] [] schedule+0x29/0x70 [ 1693.369939] [] schedule_timeout+0x209/0x290 [ 1693.376917] [] ? kvm_clock_read+0x33/0x40 [ 1693.380960] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1693.385805] [] ? ktime_get_ts64+0x4c/0xf0 [ 1693.389090] [] ? bit_wait+0x50/0x50 [ 1693.392353] [] io_schedule_timeout+0xad/0x130 [ 1693.397125] [] io_schedule+0x18/0x20 [ 1693.402082] [] bit_wait_io+0x11/0x50 [ 1693.407376] [] __wait_on_bit_lock+0x5f/0xc0 [ 1693.411417] [] ? bit_wait+0x50/0x50 [ 1693.416278] [] out_of_line_wait_on_bit_lock+0x81/0xb0 [ 1693.420911] [] ? wake_bit_function+0x40/0x40 [ 1693.424914] [] wait_on_bit_lock_io.constprop.40+0x2a/0x30 [ 1693.430278] [] __bread+0xe6/0xf0 [ 1693.434232] [] ldiskfs_fill_super+0x1675/0x3060 [ldiskfs] [ 1693.437867] [] mount_bdev+0x1b0/0x1f0 [ 1693.443464] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1693.449788] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1693.455336] [] mount_fs+0x39/0x1b0 [ 1693.462841] [] vfs_kern_mount+0x67/0x110 [ 1693.466034] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1693.469827] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1693.473509] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1693.478336] [] obd_setup+0x167/0x540 [obdclass] [ 1693.483071] [] class_setup+0x54f/0x830 [obdclass] [ 1693.488426] [] class_process_config+0x149b/0x2660 [obdclass] [ 1693.495005] [] ? __kmalloc+0x1e0/0x340 [ 1693.500541] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1693.505728] [] do_lcfg+0x263/0x520 [obdclass] [ 1693.509822] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1693.514135] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1693.520464] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1693.527891] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1693.533633] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1693.538071] [] mount_nodev+0x4d/0xb0 [ 1693.542360] [] lustre_mount+0x18/0x20 [lustre] [ 1693.548673] [] mount_fs+0x39/0x1b0 [ 1693.551926] [] vfs_kern_mount+0x67/0x110 [ 1693.560526] [] do_mount+0x1ef/0xce0 [ 1693.563380] [] ? copy_mount_options+0x39/0x1b0 [ 1693.569470] [] SyS_mount+0x83/0xd0 [ 1693.572818] [] system_call_fastpath+0x1f/0x24 [ 1693.579257] BUG: sleeping function called from invalid context at kernel/rwsem.c:51 [ 1693.583465] in_atomic(): 1, irqs_disabled(): 0, pid: 26604, name: mount.lustre [ 1693.587870] CPU: 0 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1693.598825] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1693.608297] Call Trace: [ 1693.609818] [] dump_stack+0x19/0x1b [ 1693.616049] [] __might_sleep+0xd9/0x100 [ 1693.623706] [] down_write+0x20/0x50 [ 1693.626602] [] register_shrinker+0x21/0x50 [ 1693.631546] [] ldiskfs_es_register_shrinker+0x65/0x70 [ldiskfs] [ 1693.633950] [] ldiskfs_fill_super+0x1800/0x3060 [ldiskfs] [ 1693.636534] [] mount_bdev+0x1b0/0x1f0 [ 1693.638520] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1693.644592] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1693.652590] [] mount_fs+0x39/0x1b0 [ 1693.654439] [] vfs_kern_mount+0x67/0x110 [ 1693.656486] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1693.660037] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1693.663023] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1693.665662] [] obd_setup+0x167/0x540 [obdclass] [ 1693.671793] [] class_setup+0x54f/0x830 [obdclass] [ 1693.675482] [] class_process_config+0x149b/0x2660 [obdclass] [ 1693.680942] [] ? __kmalloc+0x1e0/0x340 [ 1693.685075] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1693.690800] [] do_lcfg+0x263/0x520 [obdclass] [ 1693.695279] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1693.697583] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1693.705992] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1693.709484] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1693.711231] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1693.713346] [] mount_nodev+0x4d/0xb0 [ 1693.715361] [] lustre_mount+0x18/0x20 [lustre] [ 1693.720982] [] mount_fs+0x39/0x1b0 [ 1693.724937] [] vfs_kern_mount+0x67/0x110 [ 1693.727416] [] do_mount+0x1ef/0xce0 [ 1693.731323] [] ? copy_mount_options+0x39/0x1b0 [ 1693.735949] [] SyS_mount+0x83/0xd0 [ 1693.740174] [] system_call_fastpath+0x1f/0x24 [ 1693.749110] BUG: scheduling while atomic: mount.lustre/26604/0x10000002 [ 1693.811990] LustreError: 12987:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1693.811992] LustreError: 12987:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 2 previous similar messages [ 1693.768111] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1693.862575] CPU: 0 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1693.867754] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1693.872106] Call Trace: [ 1693.873470] [] dump_stack+0x19/0x1b [ 1693.875816] [] __schedule_bug+0x64/0x72 [ 1693.880459] [] __schedule+0x791/0x7d0 [ 1693.882993] [] __cond_resched+0x26/0x30 [ 1693.886112] [] _cond_resched+0x3a/0x50 [ 1693.888525] [] down_write+0x25/0x50 [ 1693.892425] [] register_shrinker+0x21/0x50 [ 1693.898455] [] ldiskfs_es_register_shrinker+0x65/0x70 [ldiskfs] [ 1693.905961] [] ldiskfs_fill_super+0x1800/0x3060 [ldiskfs] [ 1693.911222] [] mount_bdev+0x1b0/0x1f0 [ 1693.915970] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1693.920495] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1693.922528] [] mount_fs+0x39/0x1b0 [ 1693.925735] [] vfs_kern_mount+0x67/0x110 [ 1693.928758] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1693.932358] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1693.935347] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1693.938059] [] obd_setup+0x167/0x540 [obdclass] [ 1693.940382] [] class_setup+0x54f/0x830 [obdclass] [ 1693.944702] [] class_process_config+0x149b/0x2660 [obdclass] [ 1693.948881] [] ? __kmalloc+0x1e0/0x340 [ 1693.950920] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1693.953745] [] do_lcfg+0x263/0x520 [obdclass] [ 1693.956808] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1693.960386] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1693.964130] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1693.966801] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1693.971466] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1693.975330] [] mount_nodev+0x4d/0xb0 [ 1693.979289] [] lustre_mount+0x18/0x20 [lustre] [ 1693.985597] [] mount_fs+0x39/0x1b0 [ 1693.990352] [] vfs_kern_mount+0x67/0x110 [ 1693.992609] [] do_mount+0x1ef/0xce0 [ 1693.996004] [] ? copy_mount_options+0x39/0x1b0 [ 1693.999143] [] SyS_mount+0x83/0xd0 [ 1694.001957] [] system_call_fastpath+0x1f/0x24 [ 1694.004480] LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5 [ 1694.011265] BUG: scheduling while atomic: mount.lustre/26604/0x10000002 [ 1694.014156] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1694.048675] CPU: 1 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1694.064926] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1694.071434] Call Trace: [ 1694.072174] [] dump_stack+0x19/0x1b [ 1694.077977] [] __schedule_bug+0x64/0x72 [ 1694.081011] [] __schedule+0x791/0x7d0 [ 1694.084067] [] ? ldiskfs_alloc_inode+0x1b/0x200 [ldiskfs] [ 1694.087725] [] __cond_resched+0x26/0x30 [ 1694.089205] [] _cond_resched+0x3a/0x50 [ 1694.091063] [] kmem_cache_alloc+0x54/0x2e0 [ 1694.095941] [] ? do_raw_spin_unlock+0x49/0x90 [ 1694.099545] [] ldiskfs_alloc_inode+0x1b/0x200 [ldiskfs] [ 1694.102995] [] alloc_inode+0x1d/0xa0 [ 1694.105119] [] iget_locked+0xf8/0x1c0 [ 1694.109375] [] ldiskfs_iget+0x42/0xc60 [ldiskfs] [ 1694.113625] [] ? vprintk_emit+0x3e4/0x560 [ 1694.117727] [] ldiskfs_load_journal+0x19e/0x71c [ldiskfs] [ 1694.120965] [] ? printk+0x5d/0x74 [ 1694.122824] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1694.127030] [] mount_bdev+0x1b0/0x1f0 [ 1694.130949] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1694.139201] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1694.142594] [] mount_fs+0x39/0x1b0 [ 1694.144755] [] vfs_kern_mount+0x67/0x110 [ 1694.146859] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1694.150020] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1694.154394] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1694.157436] [] obd_setup+0x167/0x540 [obdclass] [ 1694.159631] [] class_setup+0x54f/0x830 [obdclass] [ 1694.162217] [] class_process_config+0x149b/0x2660 [obdclass] [ 1694.165722] [] ? __kmalloc+0x1e0/0x340 [ 1694.168042] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1694.171802] [] do_lcfg+0x263/0x520 [obdclass] [ 1694.174942] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1694.179091] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1694.181679] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1694.185546] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1694.188669] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1694.192407] [] mount_nodev+0x4d/0xb0 [ 1694.195554] [] lustre_mount+0x18/0x20 [lustre] [ 1694.199566] [] mount_fs+0x39/0x1b0 [ 1694.201939] [] vfs_kern_mount+0x67/0x110 [ 1694.203592] [] do_mount+0x1ef/0xce0 [ 1694.206821] [] ? copy_mount_options+0x39/0x1b0 [ 1694.209018] [] SyS_mount+0x83/0xd0 [ 1694.210737] [] system_call_fastpath+0x1f/0x24 [ 1694.215205] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1694.218905] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1694.263615] CPU: 0 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1694.270328] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1694.273673] Call Trace: [ 1694.277241] [] dump_stack+0x19/0x1b [ 1694.281172] [] __schedule_bug+0x64/0x72 [ 1694.283073] [] __schedule+0x791/0x7d0 [ 1694.284830] [] ? bit_wait+0x50/0x50 [ 1694.286799] [] schedule+0x29/0x70 [ 1694.288391] [] schedule_timeout+0x209/0x290 [ 1694.290323] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1694.294170] [] ? kvm_clock_read+0x33/0x40 [ 1694.297021] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1694.300130] [] ? bit_wait+0x50/0x50 [ 1694.302794] [] io_schedule_timeout+0xad/0x130 [ 1694.305854] [] io_schedule+0x18/0x20 [ 1694.307402] [] bit_wait_io+0x11/0x50 [ 1694.310493] [] __wait_on_bit+0x65/0x90 [ 1694.315657] [] ? bit_wait+0x50/0x50 [ 1694.317309] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1694.320005] [] ? wake_bit_function+0x40/0x40 [ 1694.322388] [] __wait_on_buffer+0x2a/0x30 [ 1694.325200] [] __ldiskfs_get_inode_loc+0x1bd/0x400 [ldiskfs] [ 1694.328157] [] ldiskfs_iget+0x96/0xc60 [ldiskfs] [ 1694.330468] [] ? vprintk_emit+0x3e4/0x560 [ 1694.333513] [] ldiskfs_load_journal+0x19e/0x71c [ldiskfs] [ 1694.335812] [] ? printk+0x5d/0x74 [ 1694.339424] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1694.343163] [] mount_bdev+0x1b0/0x1f0 [ 1694.344790] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1694.349281] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1694.354332] [] mount_fs+0x39/0x1b0 [ 1694.357909] [] vfs_kern_mount+0x67/0x110 [ 1694.362996] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1694.368904] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1694.375698] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1694.378725] [] obd_setup+0x167/0x540 [obdclass] [ 1694.383007] [] class_setup+0x54f/0x830 [obdclass] [ 1694.386472] [] class_process_config+0x149b/0x2660 [obdclass] [ 1694.389157] [] ? __kmalloc+0x1e0/0x340 [ 1694.391086] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1694.393101] [] do_lcfg+0x263/0x520 [obdclass] [ 1694.396638] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1694.409236] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1694.416930] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1694.422483] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1694.427602] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1694.429607] [] mount_nodev+0x4d/0xb0 [ 1694.432340] [] lustre_mount+0x18/0x20 [lustre] [ 1694.435308] [] mount_fs+0x39/0x1b0 [ 1694.438519] [] vfs_kern_mount+0x67/0x110 [ 1694.445692] [] do_mount+0x1ef/0xce0 [ 1694.452553] [] ? copy_mount_options+0x39/0x1b0 [ 1694.454500] [] SyS_mount+0x83/0xd0 [ 1694.456242] [] system_call_fastpath+0x1f/0x24 [ 1694.460501] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1694.462438] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1694.496398] CPU: 1 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1694.501076] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1694.509078] Call Trace: [ 1694.512862] [] dump_stack+0x19/0x1b [ 1694.515343] [] __schedule_bug+0x64/0x72 [ 1694.519008] [] __schedule+0x791/0x7d0 [ 1694.521784] [] ? bit_wait+0x50/0x50 [ 1694.525963] [] schedule+0x29/0x70 [ 1694.529892] [] schedule_timeout+0x209/0x290 [ 1694.535499] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1694.539166] [] ? kvm_clock_read+0x33/0x40 [ 1694.541298] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1694.543499] [] ? bit_wait+0x50/0x50 [ 1694.545013] [] io_schedule_timeout+0xad/0x130 [ 1694.547270] [] io_schedule+0x18/0x20 [ 1694.551736] [] bit_wait_io+0x11/0x50 [ 1694.556914] [] __wait_on_bit+0x65/0x90 [ 1694.559646] [] ? bit_wait+0x50/0x50 [ 1694.561611] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1694.565075] [] ? wake_bit_function+0x40/0x40 [ 1694.568254] [] __wait_on_buffer+0x2a/0x30 [ 1694.571093] [] journal_get_superblock+0x2c8/0x3a0 [jbd2] [ 1694.575286] [] jbd2_journal_wipe+0x20/0xb0 [jbd2] [ 1694.578206] [] ldiskfs_load_journal+0x5c5/0x71c [ldiskfs] [ 1694.581446] [] ? printk+0x5d/0x74 [ 1694.584960] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1694.588217] [] mount_bdev+0x1b0/0x1f0 [ 1694.591285] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1694.595399] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1694.598514] [] mount_fs+0x39/0x1b0 [ 1694.601181] [] vfs_kern_mount+0x67/0x110 [ 1694.602393] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1694.604170] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1694.609018] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1694.612036] [] obd_setup+0x167/0x540 [obdclass] [ 1694.613769] [] class_setup+0x54f/0x830 [obdclass] [ 1694.616413] [] class_process_config+0x149b/0x2660 [obdclass] [ 1694.618563] [] ? __kmalloc+0x1e0/0x340 [ 1694.620597] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1694.623462] [] do_lcfg+0x263/0x520 [obdclass] [ 1694.626291] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1694.629185] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1694.632606] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1694.635876] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1694.637994] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1694.640437] [] mount_nodev+0x4d/0xb0 [ 1694.643348] [] lustre_mount+0x18/0x20 [lustre] [ 1694.646297] [] mount_fs+0x39/0x1b0 [ 1694.649343] [] vfs_kern_mount+0x67/0x110 [ 1694.651032] [] do_mount+0x1ef/0xce0 [ 1694.652455] [] ? copy_mount_options+0x39/0x1b0 [ 1694.654283] [] SyS_mount+0x83/0xd0 [ 1694.655655] [] system_call_fastpath+0x1f/0x24 [ 1694.660671] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1694.663309] in_atomic(): 1, irqs_disabled(): 0, pid: 26604, name: mount.lustre [ 1694.669211] CPU: 0 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1694.672870] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1694.677120] Call Trace: [ 1694.680950] [] dump_stack+0x19/0x1b [ 1694.682606] [] __might_sleep+0xd9/0x100 [ 1694.684318] [] kmem_cache_alloc_trace+0x57/0x2e0 [ 1694.686234] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1694.688356] [] ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1694.693230] [] ? printk+0x5d/0x74 [ 1694.697946] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1694.701595] [] mount_bdev+0x1b0/0x1f0 [ 1694.706867] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1694.710042] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1694.715968] [] mount_fs+0x39/0x1b0 [ 1694.718208] [] vfs_kern_mount+0x67/0x110 [ 1694.720006] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1694.723062] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1694.728896] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1694.732260] [] obd_setup+0x167/0x540 [obdclass] [ 1694.735633] [] class_setup+0x54f/0x830 [obdclass] [ 1694.739274] [] class_process_config+0x149b/0x2660 [obdclass] [ 1694.743699] [] ? __kmalloc+0x1e0/0x340 [ 1694.746379] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1694.748359] [] do_lcfg+0x263/0x520 [obdclass] [ 1694.751778] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1694.760073] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1694.762001] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1694.764815] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1694.768132] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1694.770571] [] mount_nodev+0x4d/0xb0 [ 1694.772388] [] lustre_mount+0x18/0x20 [lustre] [ 1694.775087] [] mount_fs+0x39/0x1b0 [ 1694.776804] [] vfs_kern_mount+0x67/0x110 [ 1694.779291] [] do_mount+0x1ef/0xce0 [ 1694.780882] [] ? copy_mount_options+0x39/0x1b0 [ 1694.786452] [] SyS_mount+0x83/0xd0 [ 1694.792930] [] system_call_fastpath+0x1f/0x24 [ 1694.797541] BUG: scheduling while atomic: mount.lustre/26604/0x10000002 [ 1694.800711] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1694.828457] CPU: 0 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1694.832380] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1694.837707] Call Trace: [ 1694.838516] [] dump_stack+0x19/0x1b [ 1694.840568] [] __schedule_bug+0x64/0x72 [ 1694.843290] [] __schedule+0x791/0x7d0 [ 1694.845186] [] __cond_resched+0x26/0x30 [ 1694.847293] [] _cond_resched+0x3a/0x50 [ 1694.850185] [] kmem_cache_alloc_trace+0x5c/0x2e0 [ 1694.852817] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1694.856726] [] ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1694.858645] [] ? printk+0x5d/0x74 [ 1694.861206] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1694.864620] [] mount_bdev+0x1b0/0x1f0 [ 1694.866392] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1694.869499] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1694.871760] [] mount_fs+0x39/0x1b0 [ 1694.874055] [] vfs_kern_mount+0x67/0x110 [ 1694.876396] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1694.879898] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1694.882442] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1694.884349] [] obd_setup+0x167/0x540 [obdclass] [ 1694.886229] [] class_setup+0x54f/0x830 [obdclass] [ 1694.888711] [] class_process_config+0x149b/0x2660 [obdclass] [ 1694.891888] [] ? __kmalloc+0x1e0/0x340 [ 1694.895885] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1694.900170] [] do_lcfg+0x263/0x520 [obdclass] [ 1694.903377] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1694.905988] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1694.908242] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1694.911457] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1694.917505] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1694.922263] [] mount_nodev+0x4d/0xb0 [ 1694.924406] [] lustre_mount+0x18/0x20 [lustre] [ 1694.927271] [] mount_fs+0x39/0x1b0 [ 1694.931361] [] vfs_kern_mount+0x67/0x110 [ 1694.934296] [] do_mount+0x1ef/0xce0 [ 1694.936258] [] ? copy_mount_options+0x39/0x1b0 [ 1694.937872] [] SyS_mount+0x83/0xd0 [ 1694.940006] [] system_call_fastpath+0x1f/0x24 [ 1694.942776] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1694.946466] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1694.973411] CPU: 2 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1694.979219] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1694.984756] Call Trace: [ 1694.988000] [] dump_stack+0x19/0x1b [ 1694.989901] [] __schedule_bug+0x64/0x72 [ 1694.992172] [] __schedule+0x791/0x7d0 [ 1694.994010] [] ? enqueue_entity+0x2ef/0xc30 [ 1694.995401] [] schedule+0x29/0x70 [ 1694.998237] [] schedule_timeout+0x209/0x290 [ 1695.000161] [] ? sched_clock_cpu+0xa5/0xe0 [ 1695.002375] [] ? check_preempt_curr+0x80/0xa0 [ 1695.004627] [] ? ttwu_do_wakeup+0x19/0xf0 [ 1695.005895] [] wait_for_completion+0xfc/0x140 [ 1695.007651] [] ? wake_up_state+0x20/0x20 [ 1695.009277] [] kthread_create_on_node+0xa8/0x140 [ 1695.011892] [] ? commit_timeout+0x10/0x10 [jbd2] [ 1695.013770] [] jbd2_journal_load+0x16b/0x2d0 [jbd2] [ 1695.015906] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1695.019062] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 1695.021522] [] ? printk+0x5d/0x74 [ 1695.024007] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1695.030869] [] mount_bdev+0x1b0/0x1f0 [ 1695.032610] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1695.037286] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1695.040469] [] mount_fs+0x39/0x1b0 [ 1695.042812] [] vfs_kern_mount+0x67/0x110 [ 1695.044743] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1695.048102] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1695.051917] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1695.054423] [] obd_setup+0x167/0x540 [obdclass] [ 1695.056655] [] class_setup+0x54f/0x830 [obdclass] [ 1695.058443] [] class_process_config+0x149b/0x2660 [obdclass] [ 1695.060741] [] ? __kmalloc+0x1e0/0x340 [ 1695.062281] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1695.066650] [] do_lcfg+0x263/0x520 [obdclass] [ 1695.072005] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1695.076689] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1695.082046] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1695.085185] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1695.090583] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1695.094289] [] mount_nodev+0x4d/0xb0 [ 1695.096352] [] lustre_mount+0x18/0x20 [lustre] [ 1695.099211] [] mount_fs+0x39/0x1b0 [ 1695.102365] [] vfs_kern_mount+0x67/0x110 [ 1695.106037] [] do_mount+0x1ef/0xce0 [ 1695.108300] [] ? copy_mount_options+0x39/0x1b0 [ 1695.111557] [] SyS_mount+0x83/0xd0 [ 1695.113325] [] system_call_fastpath+0x1f/0x24 [ 1695.115493] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1695.117590] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1695.143260] CPU: 2 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1695.147512] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1695.150164] Call Trace: [ 1695.151120] [] dump_stack+0x19/0x1b [ 1695.153200] [] __schedule_bug+0x64/0x72 [ 1695.154870] [] __schedule+0x791/0x7d0 [ 1695.156943] [] schedule+0x29/0x70 [ 1695.159866] [] jbd2_journal_load+0x215/0x2d0 [jbd2] [ 1695.161849] [] ? wake_up_atomic_t+0x30/0x30 [ 1695.164448] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 1695.167641] [] ? printk+0x5d/0x74 [ 1695.170969] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1695.176951] [] mount_bdev+0x1b0/0x1f0 [ 1695.180313] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1695.184456] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1695.187403] [] mount_fs+0x39/0x1b0 [ 1695.189242] [] vfs_kern_mount+0x67/0x110 [ 1695.191367] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1695.193976] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1695.196530] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1695.198965] [] obd_setup+0x167/0x540 [obdclass] [ 1695.201457] [] class_setup+0x54f/0x830 [obdclass] [ 1695.203873] [] class_process_config+0x149b/0x2660 [obdclass] [ 1695.206477] [] ? __kmalloc+0x1e0/0x340 [ 1695.209515] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1695.211642] [] do_lcfg+0x263/0x520 [obdclass] [ 1695.215610] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1695.220312] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1695.225723] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1695.228465] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1695.230629] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1695.232816] [] mount_nodev+0x4d/0xb0 [ 1695.234537] [] lustre_mount+0x18/0x20 [lustre] [ 1695.236658] [] mount_fs+0x39/0x1b0 [ 1695.238766] [] vfs_kern_mount+0x67/0x110 [ 1695.240691] [] do_mount+0x1ef/0xce0 [ 1695.245599] [] ? copy_mount_options+0x39/0x1b0 [ 1695.247846] [] SyS_mount+0x83/0xd0 [ 1695.250435] [] system_call_fastpath+0x1f/0x24 [ 1695.254512] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1695.259109] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1695.288138] CPU: 3 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1695.292180] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1695.299175] Call Trace: [ 1695.300168] [] dump_stack+0x19/0x1b [ 1695.302084] [] __schedule_bug+0x64/0x72 [ 1695.303894] [] __schedule+0x791/0x7d0 [ 1695.307082] [] ? enqueue_entity+0x2ef/0xc30 [ 1695.309358] [] schedule+0x29/0x70 [ 1695.311270] [] schedule_timeout+0x209/0x290 [ 1695.317809] [] ? select_task_rq_fair+0x65c/0x780 [ 1695.320482] [] ? enqueue_task_fair+0x208/0x6c0 [ 1695.322793] [] ? check_preempt_curr+0x80/0xa0 [ 1695.325061] [] ? ttwu_do_wakeup+0x19/0xf0 [ 1695.327238] [] wait_for_completion+0xfc/0x140 [ 1695.329547] [] ? wake_up_state+0x20/0x20 [ 1695.332585] [] kthread_create_on_node+0xa8/0x140 [ 1695.334645] [] ? process_one_work+0x4a0/0x4a0 [ 1695.336720] [] __alloc_workqueue_key+0x336/0x480 [ 1695.338557] [] ? do_raw_spin_unlock+0x49/0x90 [ 1695.340193] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 1695.345424] [] mount_bdev+0x1b0/0x1f0 [ 1695.350494] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1695.356149] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1695.361957] [] mount_fs+0x39/0x1b0 [ 1695.366200] [] vfs_kern_mount+0x67/0x110 [ 1695.368404] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1695.376191] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1695.383616] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1695.386307] [] obd_setup+0x167/0x540 [obdclass] [ 1695.388116] [] class_setup+0x54f/0x830 [obdclass] [ 1695.397312] [] class_process_config+0x149b/0x2660 [obdclass] [ 1695.407539] [] ? __kmalloc+0x1e0/0x340 [ 1695.416681] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1695.421468] [] do_lcfg+0x263/0x520 [obdclass] [ 1695.423354] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1695.428111] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1695.433184] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1695.436247] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1695.439636] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1695.442756] [] mount_nodev+0x4d/0xb0 [ 1695.446934] [] lustre_mount+0x18/0x20 [lustre] [ 1695.449660] [] mount_fs+0x39/0x1b0 [ 1695.451111] [] vfs_kern_mount+0x67/0x110 [ 1695.452997] [] do_mount+0x1ef/0xce0 [ 1695.454735] [] ? copy_mount_options+0x39/0x1b0 [ 1695.456304] [] SyS_mount+0x83/0xd0 [ 1695.457531] [] system_call_fastpath+0x1f/0x24 [ 1695.461244] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1695.464161] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1695.485587] CPU: 2 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1695.488407] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1695.493957] Call Trace: [ 1695.494708] [] dump_stack+0x19/0x1b [ 1695.497570] [] __schedule_bug+0x64/0x72 [ 1695.499210] [] __schedule+0x791/0x7d0 [ 1695.500552] [] ? bit_wait+0x50/0x50 [ 1695.501762] [] schedule+0x29/0x70 [ 1695.503790] [] schedule_timeout+0x209/0x290 [ 1695.505674] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1695.508706] [] ? kvm_clock_read+0x33/0x40 [ 1695.510843] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1695.512984] [] ? ktime_get_ts64+0x4c/0xf0 [ 1695.515037] [] ? bit_wait+0x50/0x50 [ 1695.516798] [] io_schedule_timeout+0xad/0x130 [ 1695.521182] [] io_schedule+0x18/0x20 [ 1695.523388] [] bit_wait_io+0x11/0x50 [ 1695.525382] [] __wait_on_bit+0x65/0x90 [ 1695.527664] [] ? bit_wait+0x50/0x50 [ 1695.529607] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1695.532925] [] ? wake_bit_function+0x40/0x40 [ 1695.535403] [] __sync_dirty_buffer+0xe8/0x110 [ 1695.537392] [] sync_dirty_buffer+0x13/0x20 [ 1695.539553] [] ldiskfs_commit_super+0x1e0/0x280 [ldiskfs] [ 1695.542311] [] ldiskfs_setup_super+0x120/0x190 [ldiskfs] [ 1695.544873] [] ldiskfs_fill_super+0x2429/0x3060 [ldiskfs] [ 1695.547338] [] mount_bdev+0x1b0/0x1f0 [ 1695.549096] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1695.551342] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1695.554269] [] mount_fs+0x39/0x1b0 [ 1695.558037] [] vfs_kern_mount+0x67/0x110 [ 1695.561168] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1695.563649] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1695.566649] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1695.572175] [] obd_setup+0x167/0x540 [obdclass] [ 1695.574504] [] class_setup+0x54f/0x830 [obdclass] [ 1695.577245] [] class_process_config+0x149b/0x2660 [obdclass] [ 1695.579849] [] ? __kmalloc+0x1e0/0x340 [ 1695.581438] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1695.585242] [] do_lcfg+0x263/0x520 [obdclass] [ 1695.587680] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1695.593154] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1695.595470] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1695.599134] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1695.603357] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1695.607998] [] mount_nodev+0x4d/0xb0 [ 1695.610548] [] lustre_mount+0x18/0x20 [lustre] [ 1695.613298] [] mount_fs+0x39/0x1b0 [ 1695.618465] [] vfs_kern_mount+0x67/0x110 [ 1695.623899] [] do_mount+0x1ef/0xce0 [ 1695.625993] [] ? copy_mount_options+0x39/0x1b0 [ 1695.628659] [] SyS_mount+0x83/0xd0 [ 1695.633134] [] system_call_fastpath+0x1f/0x24 [ 1695.636541] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1695.639357] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1695.674206] CPU: 2 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1695.677197] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1695.680674] Call Trace: [ 1695.681673] [] dump_stack+0x19/0x1b [ 1695.683926] [] __schedule_bug+0x64/0x72 [ 1695.686008] [] __schedule+0x791/0x7d0 [ 1695.689333] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1695.692531] [] ? bit_wait+0x50/0x50 [ 1695.694621] [] schedule+0x29/0x70 [ 1695.696562] [] schedule_timeout+0x209/0x290 [ 1695.698996] [] ? kvm_clock_read+0x33/0x40 [ 1695.702412] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1695.705655] [] ? ktime_get_ts64+0x4c/0xf0 [ 1695.710550] [] ? bit_wait+0x50/0x50 [ 1695.714615] [] io_schedule_timeout+0xad/0x130 [ 1695.717050] [] io_schedule+0x18/0x20 [ 1695.719212] [] bit_wait_io+0x11/0x50 [ 1695.723910] [] __wait_on_bit+0x65/0x90 [ 1695.726339] [] ? bit_wait+0x50/0x50 [ 1695.730899] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1695.735632] [] ? wake_bit_function+0x40/0x40 [ 1695.738007] [] __wait_on_buffer+0x2a/0x30 [ 1695.740023] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1695.742282] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1695.744367] [] v2_read_header+0x1f/0x50 [ 1695.745672] [] v2_check_quota_file+0x2b/0x70 [ 1695.747049] [] ? igrab+0x36/0x60 [ 1695.750992] [] vfs_load_quota_inode+0x279/0x570 [ 1695.755392] [] ? unlock_new_inode+0x55/0x80 [ 1695.760153] [] dquot_enable+0xf0/0x110 [ 1695.765265] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1695.769880] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1695.774642] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1695.778918] [] mount_bdev+0x1b0/0x1f0 [ 1695.783372] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1695.786011] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1695.788054] [] mount_fs+0x39/0x1b0 [ 1695.789838] [] vfs_kern_mount+0x67/0x110 [ 1695.792807] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1695.795221] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1695.797806] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1695.801929] [] obd_setup+0x167/0x540 [obdclass] [ 1695.806032] [] class_setup+0x54f/0x830 [obdclass] [ 1695.809402] [] class_process_config+0x149b/0x2660 [obdclass] [ 1695.811957] [] ? __kmalloc+0x1e0/0x340 [ 1695.813714] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1695.815785] [] do_lcfg+0x263/0x520 [obdclass] [ 1695.818033] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1695.820629] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1695.823655] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1695.826225] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1695.829205] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1695.831860] [] mount_nodev+0x4d/0xb0 [ 1695.833926] [] lustre_mount+0x18/0x20 [lustre] [ 1695.844145] [] mount_fs+0x39/0x1b0 [ 1695.849446] [] vfs_kern_mount+0x67/0x110 [ 1695.855128] [] do_mount+0x1ef/0xce0 [ 1695.857107] [] ? copy_mount_options+0x39/0x1b0 [ 1695.859487] [] SyS_mount+0x83/0xd0 [ 1695.861120] [] system_call_fastpath+0x1f/0x24 [ 1695.862886] BUG: sleeping function called from invalid context at kernel/mutex.c:104 [ 1695.873252] in_atomic(): 1, irqs_disabled(): 0, pid: 26604, name: mount.lustre [ 1695.884082] CPU: 3 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1695.895292] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1695.905794] Call Trace: [ 1695.906599] [] dump_stack+0x19/0x1b [ 1695.920497] [] __might_sleep+0xd9/0x100 [ 1695.922469] [] mutex_lock+0x20/0x40 [ 1695.929774] [] vfs_load_quota_inode+0x2d8/0x570 [ 1695.932161] [] dquot_enable+0xf0/0x110 [ 1695.935625] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1695.937844] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1695.941748] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1695.946764] [] mount_bdev+0x1b0/0x1f0 [ 1695.949420] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1695.952268] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1695.956450] [] mount_fs+0x39/0x1b0 [ 1695.958829] [] vfs_kern_mount+0x67/0x110 [ 1695.960783] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1695.965131] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1695.969883] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1695.974237] [] obd_setup+0x167/0x540 [obdclass] [ 1695.978183] [] class_setup+0x54f/0x830 [obdclass] [ 1695.980597] [] class_process_config+0x149b/0x2660 [obdclass] [ 1695.983218] [] ? __kmalloc+0x1e0/0x340 [ 1695.985105] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1695.987347] [] do_lcfg+0x263/0x520 [obdclass] [ 1695.989479] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1695.992172] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1695.994479] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1695.996847] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1696.002504] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1696.007017] [] mount_nodev+0x4d/0xb0 [ 1696.010928] [] lustre_mount+0x18/0x20 [lustre] [ 1696.015164] [] mount_fs+0x39/0x1b0 [ 1696.020121] [] vfs_kern_mount+0x67/0x110 [ 1696.022924] [] do_mount+0x1ef/0xce0 [ 1696.024417] [] ? copy_mount_options+0x39/0x1b0 [ 1696.029419] [] SyS_mount+0x83/0xd0 [ 1696.033071] [] system_call_fastpath+0x1f/0x24 [ 1696.035303] BUG: scheduling while atomic: mount.lustre/26604/0x10000002 [ 1696.039180] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1696.067331] CPU: 3 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1696.072576] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1696.077463] Call Trace: [ 1696.078734] [] dump_stack+0x19/0x1b [ 1696.081556] [] __schedule_bug+0x64/0x72 [ 1696.084317] [] __schedule+0x791/0x7d0 [ 1696.086506] [] __cond_resched+0x26/0x30 [ 1696.088398] [] _cond_resched+0x3a/0x50 [ 1696.091118] [] mutex_lock+0x25/0x40 [ 1696.092569] [] vfs_load_quota_inode+0x2d8/0x570 [ 1696.095095] [] dquot_enable+0xf0/0x110 [ 1696.097670] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1696.100824] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1696.103342] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1696.106264] [] mount_bdev+0x1b0/0x1f0 [ 1696.108643] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1696.111412] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1696.113709] [] mount_fs+0x39/0x1b0 [ 1696.115215] [] vfs_kern_mount+0x67/0x110 [ 1696.119143] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1696.123433] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1696.126454] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1696.133503] [] obd_setup+0x167/0x540 [obdclass] [ 1696.135228] [] class_setup+0x54f/0x830 [obdclass] [ 1696.140065] [] class_process_config+0x149b/0x2660 [obdclass] [ 1696.143203] [] ? __kmalloc+0x1e0/0x340 [ 1696.145466] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1696.147751] [] do_lcfg+0x263/0x520 [obdclass] [ 1696.149995] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1696.152970] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1696.155990] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1696.158763] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1696.161670] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1696.167471] [] mount_nodev+0x4d/0xb0 [ 1696.169925] [] lustre_mount+0x18/0x20 [lustre] [ 1696.174885] [] mount_fs+0x39/0x1b0 [ 1696.176917] [] vfs_kern_mount+0x67/0x110 [ 1696.179080] [] do_mount+0x1ef/0xce0 [ 1696.181342] [] ? copy_mount_options+0x39/0x1b0 [ 1696.183386] [] SyS_mount+0x83/0xd0 [ 1696.185378] [] system_call_fastpath+0x1f/0x24 [ 1696.188148] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1696.190834] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1696.217673] CPU: 2 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1696.223115] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1696.231647] Call Trace: [ 1696.232608] [] dump_stack+0x19/0x1b [ 1696.236236] [] __schedule_bug+0x64/0x72 [ 1696.244072] [] __schedule+0x791/0x7d0 [ 1696.246827] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1696.250384] [] ? bit_wait+0x50/0x50 [ 1696.253595] [] schedule+0x29/0x70 [ 1696.255718] [] schedule_timeout+0x209/0x290 [ 1696.257966] [] ? kvm_clock_read+0x33/0x40 [ 1696.260457] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1696.264522] [] ? ktime_get_ts64+0x4c/0xf0 [ 1696.267324] [] ? bit_wait+0x50/0x50 [ 1696.270546] [] io_schedule_timeout+0xad/0x130 [ 1696.274522] [] io_schedule+0x18/0x20 [ 1696.277890] [] bit_wait_io+0x11/0x50 [ 1696.280794] [] __wait_on_bit+0x65/0x90 [ 1696.284194] [] ? bit_wait+0x50/0x50 [ 1696.287300] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1696.290036] [] ? wake_bit_function+0x40/0x40 [ 1696.292142] [] __wait_on_buffer+0x2a/0x30 [ 1696.297129] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1696.299631] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1696.302598] [] v2_read_header+0x1f/0x50 [ 1696.305018] [] v2_check_quota_file+0x2b/0x70 [ 1696.307416] [] ? igrab+0x36/0x60 [ 1696.309598] [] vfs_load_quota_inode+0x279/0x570 [ 1696.313393] [] ? unlock_new_inode+0x55/0x80 [ 1696.317712] [] dquot_enable+0xf0/0x110 [ 1696.320467] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1696.326162] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1696.331516] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1696.334531] [] mount_bdev+0x1b0/0x1f0 [ 1696.339943] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1696.346348] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1696.349669] [] mount_fs+0x39/0x1b0 [ 1696.355763] [] vfs_kern_mount+0x67/0x110 [ 1696.360921] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1696.363462] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1696.366204] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1696.370006] [] obd_setup+0x167/0x540 [obdclass] [ 1696.373415] [] class_setup+0x54f/0x830 [obdclass] [ 1696.376748] [] class_process_config+0x149b/0x2660 [obdclass] [ 1696.381410] [] ? __kmalloc+0x1e0/0x340 [ 1696.384052] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1696.388718] [] do_lcfg+0x263/0x520 [obdclass] [ 1696.392374] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1696.396218] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1696.400652] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1696.403894] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1696.406846] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1696.410846] [] mount_nodev+0x4d/0xb0 [ 1696.413340] [] lustre_mount+0x18/0x20 [lustre] [ 1696.416397] [] mount_fs+0x39/0x1b0 [ 1696.419002] [] vfs_kern_mount+0x67/0x110 [ 1696.421924] [] do_mount+0x1ef/0xce0 [ 1696.424216] [] ? copy_mount_options+0x39/0x1b0 [ 1696.427413] [] SyS_mount+0x83/0xd0 [ 1696.431567] [] system_call_fastpath+0x1f/0x24 [ 1696.435083] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1696.439453] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1696.474369] CPU: 3 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1696.482951] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1696.492482] Call Trace: [ 1696.493513] [] dump_stack+0x19/0x1b [ 1696.495909] [] __schedule_bug+0x64/0x72 [ 1696.501600] [] __schedule+0x791/0x7d0 [ 1696.506116] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1696.508190] [] ? bit_wait+0x50/0x50 [ 1696.509995] [] schedule+0x29/0x70 [ 1696.511566] [] schedule_timeout+0x209/0x290 [ 1696.516006] [] ? kvm_clock_read+0x33/0x40 [ 1696.518881] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1696.520856] [] ? ktime_get_ts64+0x4c/0xf0 [ 1696.524519] [] ? bit_wait+0x50/0x50 [ 1696.529438] [] io_schedule_timeout+0xad/0x130 [ 1696.531849] [] io_schedule+0x18/0x20 [ 1696.534017] [] bit_wait_io+0x11/0x50 [ 1696.537361] [] __wait_on_bit+0x65/0x90 [ 1696.539975] [] ? bit_wait+0x50/0x50 [ 1696.541511] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1696.543867] [] ? wake_bit_function+0x40/0x40 [ 1696.545407] [] __wait_on_buffer+0x2a/0x30 [ 1696.549130] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1696.552049] [] ? mark_page_accessed+0xd8/0xe0 [ 1696.556472] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1696.558331] [] v2_read_header+0x1f/0x50 [ 1696.562585] [] v2_check_quota_file+0x2b/0x70 [ 1696.564421] [] ? igrab+0x36/0x60 [ 1696.565870] [] vfs_load_quota_inode+0x279/0x570 [ 1696.568468] [] ? unlock_new_inode+0x55/0x80 [ 1696.571491] [] dquot_enable+0xf0/0x110 [ 1696.575307] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1696.578410] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1696.582872] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1696.587981] [] mount_bdev+0x1b0/0x1f0 [ 1696.590917] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1696.595773] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1696.599352] [] mount_fs+0x39/0x1b0 [ 1696.601595] [] vfs_kern_mount+0x67/0x110 [ 1696.604493] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1696.607525] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1696.610828] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1696.613916] [] obd_setup+0x167/0x540 [obdclass] [ 1696.616368] [] class_setup+0x54f/0x830 [obdclass] [ 1696.620394] [] class_process_config+0x149b/0x2660 [obdclass] [ 1696.622694] [] ? __kmalloc+0x1e0/0x340 [ 1696.625317] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1696.627706] [] do_lcfg+0x263/0x520 [obdclass] [ 1696.631145] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1696.634149] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1696.637917] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1696.640319] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1696.642288] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1696.645142] [] mount_nodev+0x4d/0xb0 [ 1696.647140] [] lustre_mount+0x18/0x20 [lustre] [ 1696.649754] [] mount_fs+0x39/0x1b0 [ 1696.651664] [] vfs_kern_mount+0x67/0x110 [ 1696.655262] [] do_mount+0x1ef/0xce0 [ 1696.657580] [] ? copy_mount_options+0x39/0x1b0 [ 1696.660215] [] SyS_mount+0x83/0xd0 [ 1696.663334] [] system_call_fastpath+0x1f/0x24 [ 1696.665948] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1696.672107] BUG: scheduling while atomic: mount.lustre/26604/0x10000002 [ 1696.674750] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1696.701993] CPU: 2 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1696.706381] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1696.709542] Call Trace: [ 1696.710517] [] dump_stack+0x19/0x1b [ 1696.714337] [] __schedule_bug+0x64/0x72 [ 1696.717031] [] __schedule+0x791/0x7d0 [ 1696.719257] [] ? dquot_alloc+0x1a/0x20 [ 1696.721302] [] __cond_resched+0x26/0x30 [ 1696.722990] [] _cond_resched+0x3a/0x50 [ 1696.726851] [] kmem_cache_alloc+0x54/0x2e0 [ 1696.730145] [] ? cfs_trace_unlock_tcd+0x27/0x70 [libcfs] [ 1696.734121] [] ? libcfs_debug_msg+0x4c9/0xc60 [libcfs] [ 1696.736656] [] dquot_alloc+0x1a/0x20 [ 1696.739077] [] dqget+0x242/0x460 [ 1696.742094] [] __dquot_initialize+0x12d/0x230 [ 1696.744431] [] ? free_pages.part.76+0x40/0x50 [ 1696.746532] [] dquot_initialize+0x13/0x20 [ 1696.748713] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1696.752226] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1696.755790] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1696.758821] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1696.763573] [] obd_setup+0x167/0x540 [obdclass] [ 1696.767156] [] class_setup+0x54f/0x830 [obdclass] [ 1696.771043] [] class_process_config+0x149b/0x2660 [obdclass] [ 1696.775098] [] ? __kmalloc+0x1e0/0x340 [ 1696.779386] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1696.782420] [] do_lcfg+0x263/0x520 [obdclass] [ 1696.786906] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1696.789981] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1696.792252] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1696.795700] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1696.799452] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1696.802689] [] mount_nodev+0x4d/0xb0 [ 1696.805874] [] lustre_mount+0x18/0x20 [lustre] [ 1696.809599] [] mount_fs+0x39/0x1b0 [ 1696.811864] [] vfs_kern_mount+0x67/0x110 [ 1696.813443] [] do_mount+0x1ef/0xce0 [ 1696.815263] [] ? copy_mount_options+0x39/0x1b0 [ 1696.817106] [] SyS_mount+0x83/0xd0 [ 1696.818796] [] system_call_fastpath+0x1f/0x24 [ 1696.825271] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1696.829981] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1696.861483] CPU: 3 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1696.869548] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1696.873577] Call Trace: [ 1696.877059] [] dump_stack+0x19/0x1b [ 1696.879012] [] __schedule_bug+0x64/0x72 [ 1696.880847] [] __schedule+0x791/0x7d0 [ 1696.882897] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1696.885139] [] ? bit_wait+0x50/0x50 [ 1696.886710] [] schedule+0x29/0x70 [ 1696.888095] [] schedule_timeout+0x209/0x290 [ 1696.890058] [] ? kvm_clock_read+0x33/0x40 [ 1696.894788] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1696.898688] [] ? ktime_get_ts64+0x4c/0xf0 [ 1696.902883] [] ? bit_wait+0x50/0x50 [ 1696.906923] [] io_schedule_timeout+0xad/0x130 [ 1696.911422] [] io_schedule+0x18/0x20 [ 1696.914957] [] bit_wait_io+0x11/0x50 [ 1696.920007] [] __wait_on_bit+0x65/0x90 [ 1696.925456] [] ? bit_wait+0x50/0x50 [ 1696.929076] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1696.932485] [] ? wake_bit_function+0x40/0x40 [ 1696.937037] [] __wait_on_buffer+0x2a/0x30 [ 1696.940617] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1696.942946] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1696.947023] [] read_blk+0x4c/0x60 [ 1696.949259] [] find_tree_dqentry+0x47/0x240 [ 1696.952083] [] find_tree_dqentry+0x1aa/0x240 [ 1696.953534] [] find_tree_dqentry+0x1aa/0x240 [ 1696.956016] [] find_tree_dqentry+0x1aa/0x240 [ 1696.960654] [] qtree_read_dquot+0x14c/0x380 [ 1696.962637] [] v2_read_dquot+0x2b/0x30 [ 1696.965251] [] dquot_acquire+0xe4/0x130 [ 1696.967483] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1696.970846] [] dqget+0x3fb/0x460 [ 1696.973314] [] __dquot_initialize+0x12d/0x230 [ 1696.975182] [] ? free_pages.part.76+0x40/0x50 [ 1696.978833] [] dquot_initialize+0x13/0x20 [ 1696.981269] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1696.984654] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1696.986922] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1696.989742] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1696.992617] [] obd_setup+0x167/0x540 [obdclass] [ 1696.994565] [] class_setup+0x54f/0x830 [obdclass] [ 1696.997459] [] class_process_config+0x149b/0x2660 [obdclass] [ 1697.000166] [] ? __kmalloc+0x1e0/0x340 [ 1697.002139] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1697.006630] [] do_lcfg+0x263/0x520 [obdclass] [ 1697.008913] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1697.011678] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1697.015447] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1697.018640] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1697.022677] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1697.026112] [] mount_nodev+0x4d/0xb0 [ 1697.030117] [] lustre_mount+0x18/0x20 [lustre] [ 1697.032615] [] mount_fs+0x39/0x1b0 [ 1697.036100] [] vfs_kern_mount+0x67/0x110 [ 1697.038155] [] do_mount+0x1ef/0xce0 [ 1697.040574] [] ? copy_mount_options+0x39/0x1b0 [ 1697.042481] [] SyS_mount+0x83/0xd0 [ 1697.048101] [] system_call_fastpath+0x1f/0x24 [ 1697.055993] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1697.058311] in_atomic(): 1, irqs_disabled(): 0, pid: 26604, name: mount.lustre [ 1697.061328] CPU: 2 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1697.066984] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1697.070690] Call Trace: [ 1697.071610] [] dump_stack+0x19/0x1b [ 1697.074369] [] __might_sleep+0xd9/0x100 [ 1697.076605] [] __kmalloc+0x73/0x340 [ 1697.079869] [] ? getdqbuf+0x14/0x40 [ 1697.081603] [] getdqbuf+0x14/0x40 [ 1697.084089] [] find_tree_dqentry+0xaf/0x240 [ 1697.090876] [] find_tree_dqentry+0x1aa/0x240 [ 1697.093042] [] find_tree_dqentry+0x1aa/0x240 [ 1697.096463] [] find_tree_dqentry+0x1aa/0x240 [ 1697.098193] [] qtree_read_dquot+0x14c/0x380 [ 1697.099574] [] v2_read_dquot+0x2b/0x30 [ 1697.103167] [] dquot_acquire+0xe4/0x130 [ 1697.105948] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1697.112181] [] dqget+0x3fb/0x460 [ 1697.114360] [] __dquot_initialize+0x12d/0x230 [ 1697.116632] [] ? free_pages.part.76+0x40/0x50 [ 1697.120701] [] dquot_initialize+0x13/0x20 [ 1697.124014] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1697.126544] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1697.128201] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1697.130304] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1697.132823] [] obd_setup+0x167/0x540 [obdclass] [ 1697.135107] [] class_setup+0x54f/0x830 [obdclass] [ 1697.137707] [] class_process_config+0x149b/0x2660 [obdclass] [ 1697.143232] [] ? __kmalloc+0x1e0/0x340 [ 1697.147510] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1697.151633] [] do_lcfg+0x263/0x520 [obdclass] [ 1697.154502] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1697.159515] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1697.163741] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1697.167931] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1697.171317] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1697.176362] [] mount_nodev+0x4d/0xb0 [ 1697.180409] [] lustre_mount+0x18/0x20 [lustre] [ 1697.183441] [] mount_fs+0x39/0x1b0 [ 1697.188008] [] vfs_kern_mount+0x67/0x110 [ 1697.190940] [] do_mount+0x1ef/0xce0 [ 1697.192959] [] ? copy_mount_options+0x39/0x1b0 [ 1697.195577] [] SyS_mount+0x83/0xd0 [ 1697.197788] [] system_call_fastpath+0x1f/0x24 [ 1697.200652] BUG: scheduling while atomic: mount.lustre/26604/0x10000002 [ 1697.205437] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1697.242106] CPU: 2 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1697.248450] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1697.254530] Call Trace: [ 1697.256533] [] dump_stack+0x19/0x1b [ 1697.260037] [] __schedule_bug+0x64/0x72 [ 1697.263617] [] __schedule+0x791/0x7d0 [ 1697.266470] [] __cond_resched+0x26/0x30 [ 1697.269108] [] _cond_resched+0x3a/0x50 [ 1697.272007] [] __kmalloc+0x78/0x340 [ 1697.273765] [] ? getdqbuf+0x14/0x40 [ 1697.275757] [] getdqbuf+0x14/0x40 [ 1697.277654] [] find_tree_dqentry+0xaf/0x240 [ 1697.281503] [] find_tree_dqentry+0x1aa/0x240 [ 1697.284174] [] find_tree_dqentry+0x1aa/0x240 [ 1697.285760] [] find_tree_dqentry+0x1aa/0x240 [ 1697.288264] [] qtree_read_dquot+0x14c/0x380 [ 1697.291087] [] v2_read_dquot+0x2b/0x30 [ 1697.293367] [] dquot_acquire+0xe4/0x130 [ 1697.297434] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1697.299968] [] dqget+0x3fb/0x460 [ 1697.302459] [] __dquot_initialize+0x12d/0x230 [ 1697.306191] [] ? free_pages.part.76+0x40/0x50 [ 1697.308833] [] dquot_initialize+0x13/0x20 [ 1697.311299] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1697.313658] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1697.316194] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1697.319364] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1697.322659] [] obd_setup+0x167/0x540 [obdclass] [ 1697.325430] [] class_setup+0x54f/0x830 [obdclass] [ 1697.329236] [] class_process_config+0x149b/0x2660 [obdclass] [ 1697.331542] [] ? __kmalloc+0x1e0/0x340 [ 1697.335050] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1697.337182] [] do_lcfg+0x263/0x520 [obdclass] [ 1697.340848] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1697.342953] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1697.346468] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1697.350757] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1697.353603] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1697.356364] [] mount_nodev+0x4d/0xb0 [ 1697.360716] [] lustre_mount+0x18/0x20 [lustre] [ 1697.365464] [] mount_fs+0x39/0x1b0 [ 1697.366809] [] vfs_kern_mount+0x67/0x110 [ 1697.368148] [] do_mount+0x1ef/0xce0 [ 1697.369330] [] ? copy_mount_options+0x39/0x1b0 [ 1697.373089] [] SyS_mount+0x83/0xd0 [ 1697.375329] [] system_call_fastpath+0x1f/0x24 [ 1697.381075] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1697.383380] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1697.422810] CPU: 0 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1697.426945] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1697.432307] Call Trace: [ 1697.433533] [] dump_stack+0x19/0x1b [ 1697.436213] [] __schedule_bug+0x64/0x72 [ 1697.439358] [] __schedule+0x791/0x7d0 [ 1697.443304] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1697.446671] [] ? bit_wait+0x50/0x50 [ 1697.448418] [] schedule+0x29/0x70 [ 1697.452282] [] schedule_timeout+0x209/0x290 [ 1697.455430] [] ? kvm_clock_read+0x33/0x40 [ 1697.458065] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1697.460634] [] ? ktime_get_ts64+0x4c/0xf0 [ 1697.464587] [] ? bit_wait+0x50/0x50 [ 1697.469182] [] io_schedule_timeout+0xad/0x130 [ 1697.472654] [] io_schedule+0x18/0x20 [ 1697.474645] [] bit_wait_io+0x11/0x50 [ 1697.477922] [] __wait_on_bit+0x65/0x90 [ 1697.480048] [] ? bit_wait+0x50/0x50 [ 1697.481985] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1697.484934] [] ? wake_bit_function+0x40/0x40 [ 1697.488471] [] __wait_on_buffer+0x2a/0x30 [ 1697.491721] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1697.495367] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1697.498213] [] read_blk+0x4c/0x60 [ 1697.500162] [] find_tree_dqentry+0x47/0x240 [ 1697.502351] [] find_tree_dqentry+0x1aa/0x240 [ 1697.504938] [] find_tree_dqentry+0x1aa/0x240 [ 1697.507608] [] find_tree_dqentry+0x1aa/0x240 [ 1697.510139] [] qtree_read_dquot+0x14c/0x380 [ 1697.512202] [] v2_read_dquot+0x2b/0x30 [ 1697.514326] [] dquot_acquire+0xe4/0x130 [ 1697.516262] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1697.519509] [] dqget+0x3fb/0x460 [ 1697.522526] [] __dquot_initialize+0x12d/0x230 [ 1697.525385] [] dquot_initialize+0x13/0x20 [ 1697.527480] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1697.530254] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1697.532974] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1697.537340] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1697.540615] [] obd_setup+0x167/0x540 [obdclass] [ 1697.544692] [] class_setup+0x54f/0x830 [obdclass] [ 1697.549273] [] class_process_config+0x149b/0x2660 [obdclass] [ 1697.552114] [] ? __kmalloc+0x1e0/0x340 [ 1697.554431] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1697.556807] [] do_lcfg+0x263/0x520 [obdclass] [ 1697.559235] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1697.564931] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1697.568673] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1697.571508] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1697.574892] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1697.578514] [] mount_nodev+0x4d/0xb0 [ 1697.580656] [] lustre_mount+0x18/0x20 [lustre] [ 1697.583167] [] mount_fs+0x39/0x1b0 [ 1697.586871] [] vfs_kern_mount+0x67/0x110 [ 1697.588754] [] do_mount+0x1ef/0xce0 [ 1697.593065] [] ? copy_mount_options+0x39/0x1b0 [ 1697.595709] [] SyS_mount+0x83/0xd0 [ 1697.597810] [] system_call_fastpath+0x1f/0x24 [ 1697.600181] BUG: scheduling while atomic: mount.lustre/26604/0x00000002 [ 1697.603405] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1697.630855] CPU: 3 PID: 26604 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1697.636278] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1697.640471] Call Trace: [ 1697.641904] [] dump_stack+0x19/0x1b [ 1697.643837] [] __schedule_bug+0x64/0x72 [ 1697.646230] [] __schedule+0x791/0x7d0 [ 1697.648640] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1697.651596] [] ? bit_wait+0x50/0x50 [ 1697.653571] [] schedule+0x29/0x70 [ 1697.655901] [] schedule_timeout+0x209/0x290 [ 1697.658015] [] ? kvm_clock_read+0x33/0x40 [ 1697.660313] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1697.663456] [] ? ktime_get_ts64+0x4c/0xf0 [ 1697.665534] [] ? bit_wait+0x50/0x50 [ 1697.669320] [] io_schedule_timeout+0xad/0x130 [ 1697.674021] [] io_schedule+0x18/0x20 [ 1697.676721] [] bit_wait_io+0x11/0x50 [ 1697.680896] [] __wait_on_bit+0x65/0x90 [ 1697.683054] [] ? bit_wait+0x50/0x50 [ 1697.685902] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1697.689148] [] ? wake_bit_function+0x40/0x40 [ 1697.692332] [] __wait_on_buffer+0x2a/0x30 [ 1697.695516] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1697.698079] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1697.701082] [] read_blk+0x4c/0x60 [ 1697.702888] [] find_tree_dqentry+0x47/0x240 [ 1697.705834] [] find_tree_dqentry+0x1aa/0x240 [ 1697.709114] [] find_tree_dqentry+0x1aa/0x240 [ 1697.711087] [] find_tree_dqentry+0x1aa/0x240 [ 1697.715426] [] qtree_read_dquot+0x14c/0x380 [ 1697.718096] [] v2_read_dquot+0x2b/0x30 [ 1697.720384] [] dquot_acquire+0xe4/0x130 [ 1697.722604] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1697.725332] [] dqget+0x3fb/0x460 [ 1697.727695] [] __dquot_initialize+0x12d/0x230 [ 1697.730427] [] dquot_initialize+0x13/0x20 [ 1697.733104] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1697.736807] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1697.739382] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1697.743316] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1697.746310] [] obd_setup+0x167/0x540 [obdclass] [ 1697.754109] [] class_setup+0x54f/0x830 [obdclass] [ 1697.757648] [] class_process_config+0x149b/0x2660 [obdclass] [ 1697.762419] [] ? __kmalloc+0x1e0/0x340 [ 1697.765005] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1697.767282] [] do_lcfg+0x263/0x520 [obdclass] [ 1697.771244] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1697.775069] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1697.780334] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1697.784819] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1697.787950] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1697.790616] [] mount_nodev+0x4d/0xb0 [ 1697.792445] [] lustre_mount+0x18/0x20 [lustre] [ 1697.794809] [] mount_fs+0x39/0x1b0 [ 1697.797327] [] vfs_kern_mount+0x67/0x110 [ 1697.799273] [] do_mount+0x1ef/0xce0 [ 1697.801586] [] ? copy_mount_options+0x39/0x1b0 [ 1697.803955] [] SyS_mount+0x83/0xd0 [ 1697.806465] [] system_call_fastpath+0x1f/0x24 [ 1698.008858] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1698.021716] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1698.815037] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1699.223486] Lustre: lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. [ 1699.223782] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 192.168.204.113@tcp (at 0@lo) [ 1699.223784] Lustre: Skipped 1 previous similar message [ 1700.794496] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1704.769302] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1707.408243] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1710.374852] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1712.954329] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1715.387892] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1717.872993] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1740.006244] Lustre: DEBUG MARKER: == sanity-quota test 7b: Quota reintegration (slave index) ========================================================== 07:42:14 (1750592534) [ 1756.349479] LustreError: 31570:0:(qsd_reint.c:620:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed. [ 1756.354295] LustreError: 31570:0:(qsd_reint.c:620:qqi_reint_delayed()) Skipped 14 previous similar messages [ 1759.101066] Lustre: *** cfs_fail_loc=a02, val=0*** [ 1763.474576] LustreError: 3772:0:(qsd_handler.c:354:qsd_req_completion()) $$$ DQACQ failed with -5, flags:0x8 qsd:lustre-OST0000 qtype:usr id:60000 enforced:1 granted: 1024 pending:0 waiting:0 req:1 usage: 2048 qunit:0 qtune:0 edquot:0 default:no revoke:0 [ 1763.493959] Lustre: Failing over lustre-OST0000 [ 1763.535392] LustreError: 32081:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1763.537952] LustreError: 32081:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1763.613545] Lustre: server umount lustre-OST0000 complete [ 1763.974592] LustreError: 9595:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1763.987191] LustreError: 9595:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 2 previous similar messages [ 1764.391938] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1764.400484] LustreError: Skipped 1 previous similar message [ 1764.403800] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1768.925101] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1768.927256] in_atomic(): 1, irqs_disabled(): 0, pid: 32677, name: mount.lustre [ 1768.941907] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1768.952264] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1768.963507] Call Trace: [ 1768.964280] [] dump_stack+0x19/0x1b [ 1768.971239] [] __might_sleep+0xd9/0x100 [ 1768.976236] [] kmem_cache_alloc+0x4f/0x2e0 [ 1768.982126] [] alloc_vfsmnt+0x24/0x240 [ 1768.985507] [] vfs_kern_mount+0x36/0x110 [ 1768.991707] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1768.996372] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1769.004072] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1769.007140] [] obd_setup+0x167/0x540 [obdclass] [ 1769.011786] [] class_setup+0x54f/0x830 [obdclass] [ 1769.014097] [] class_process_config+0x149b/0x2660 [obdclass] [ 1769.016882] [] ? __kmalloc+0x1e0/0x340 [ 1769.018950] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1769.021754] [] do_lcfg+0x263/0x520 [obdclass] [ 1769.024005] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1769.026306] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1769.030314] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1769.038304] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1769.041775] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1769.052684] [] mount_nodev+0x4d/0xb0 [ 1769.057774] [] lustre_mount+0x18/0x20 [lustre] [ 1769.061185] [] mount_fs+0x39/0x1b0 [ 1769.066845] [] vfs_kern_mount+0x67/0x110 [ 1769.068705] [] do_mount+0x1ef/0xce0 [ 1769.083950] [] ? copy_mount_options+0x39/0x1b0 [ 1769.090792] [] SyS_mount+0x83/0xd0 [ 1769.095249] [] system_call_fastpath+0x1f/0x24 [ 1769.098488] BUG: scheduling while atomic: mount.lustre/32677/0x10000002 [ 1769.101924] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1769.134043] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1769.143460] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1769.152458] Call Trace: [ 1769.154324] [] dump_stack+0x19/0x1b [ 1769.156258] [] __schedule_bug+0x64/0x72 [ 1769.164090] [] __schedule+0x791/0x7d0 [ 1769.169494] [] ? alloc_vfsmnt+0x24/0x240 [ 1769.172065] [] __cond_resched+0x26/0x30 [ 1769.173904] [] _cond_resched+0x3a/0x50 [ 1769.177477] [] kmem_cache_alloc+0x54/0x2e0 [ 1769.182479] [] alloc_vfsmnt+0x24/0x240 [ 1769.184902] [] vfs_kern_mount+0x36/0x110 [ 1769.188440] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1769.191096] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1769.194078] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1769.196919] [] obd_setup+0x167/0x540 [obdclass] [ 1769.199598] [] class_setup+0x54f/0x830 [obdclass] [ 1769.203032] [] class_process_config+0x149b/0x2660 [obdclass] [ 1769.206155] [] ? __kmalloc+0x1e0/0x340 [ 1769.210123] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1769.214903] [] do_lcfg+0x263/0x520 [obdclass] [ 1769.217193] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1769.219907] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1769.224584] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1769.230567] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1769.233210] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1769.240337] [] mount_nodev+0x4d/0xb0 [ 1769.242869] [] lustre_mount+0x18/0x20 [lustre] [ 1769.246543] [] mount_fs+0x39/0x1b0 [ 1769.249276] [] vfs_kern_mount+0x67/0x110 [ 1769.253568] [] do_mount+0x1ef/0xce0 [ 1769.256259] [] ? copy_mount_options+0x39/0x1b0 [ 1769.258302] [] SyS_mount+0x83/0xd0 [ 1769.259731] [] system_call_fastpath+0x1f/0x24 [ 1769.275122] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1769.278278] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1769.305821] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1769.310753] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1769.316979] Call Trace: [ 1769.318356] [] dump_stack+0x19/0x1b [ 1769.322550] [] __schedule_bug+0x64/0x72 [ 1769.324553] [] __schedule+0x791/0x7d0 [ 1769.326490] [] ? bit_wait+0x50/0x50 [ 1769.327953] [] schedule+0x29/0x70 [ 1769.329191] [] schedule_timeout+0x209/0x290 [ 1769.334100] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1769.339321] [] ? kvm_clock_read+0x33/0x40 [ 1769.341941] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1769.345329] [] ? ktime_get_ts64+0x4c/0xf0 [ 1769.348640] [] ? bit_wait+0x50/0x50 [ 1769.351914] [] io_schedule_timeout+0xad/0x130 [ 1769.354591] [] io_schedule+0x18/0x20 [ 1769.356270] [] bit_wait_io+0x11/0x50 [ 1769.359114] [] __wait_on_bit+0x65/0x90 [ 1769.362712] [] ? bit_wait+0x50/0x50 [ 1769.365391] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1769.367957] [] ? wake_bit_function+0x40/0x40 [ 1769.371067] [] __bread+0xad/0xf0 [ 1769.372867] [] ldiskfs_fill_super+0x8ff/0x3060 [ldiskfs] [ 1769.375222] [] mount_bdev+0x1b0/0x1f0 [ 1769.377565] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1769.381511] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1769.383860] [] mount_fs+0x39/0x1b0 [ 1769.386869] [] vfs_kern_mount+0x67/0x110 [ 1769.390058] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1769.393132] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1769.395723] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1769.397820] [] obd_setup+0x167/0x540 [obdclass] [ 1769.402655] [] class_setup+0x54f/0x830 [obdclass] [ 1769.405749] [] class_process_config+0x149b/0x2660 [obdclass] [ 1769.408605] [] ? __kmalloc+0x1e0/0x340 [ 1769.410555] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1769.413127] [] do_lcfg+0x263/0x520 [obdclass] [ 1769.415785] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1769.420908] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1769.425577] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1769.429042] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1769.431475] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1769.435223] [] mount_nodev+0x4d/0xb0 [ 1769.437465] [] lustre_mount+0x18/0x20 [lustre] [ 1769.445941] [] mount_fs+0x39/0x1b0 [ 1769.449786] [] vfs_kern_mount+0x67/0x110 [ 1769.453306] [] do_mount+0x1ef/0xce0 [ 1769.456161] [] ? copy_mount_options+0x39/0x1b0 [ 1769.460822] [] SyS_mount+0x83/0xd0 [ 1769.469139] [] system_call_fastpath+0x1f/0x24 [ 1769.472974] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1769.478986] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1769.513144] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1769.517233] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1769.525066] Call Trace: [ 1769.525780] [] dump_stack+0x19/0x1b [ 1769.531855] [] __schedule_bug+0x64/0x72 [ 1769.535537] [] __schedule+0x791/0x7d0 [ 1769.538001] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1769.542429] [] ? bit_wait+0x50/0x50 [ 1769.546367] [] schedule+0x29/0x70 [ 1769.548146] [] schedule_timeout+0x209/0x290 [ 1769.550229] [] ? kvm_clock_read+0x33/0x40 [ 1769.554676] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1769.564283] [] ? ktime_get_ts64+0x4c/0xf0 [ 1769.572717] [] ? bit_wait+0x50/0x50 [ 1769.574425] [] io_schedule_timeout+0xad/0x130 [ 1769.576379] [] io_schedule+0x18/0x20 [ 1769.578047] [] bit_wait_io+0x11/0x50 [ 1769.581355] [] __wait_on_bit_lock+0x5f/0xc0 [ 1769.591443] [] ? bit_wait+0x50/0x50 [ 1769.593271] [] out_of_line_wait_on_bit_lock+0x81/0xb0 [ 1769.595503] [] ? wake_bit_function+0x40/0x40 [ 1769.609915] [] wait_on_bit_lock_io.constprop.40+0x2a/0x30 [ 1769.616687] [] __bread+0xe6/0xf0 [ 1769.618318] [] ldiskfs_fill_super+0x1675/0x3060 [ldiskfs] [ 1769.621447] [] mount_bdev+0x1b0/0x1f0 [ 1769.624498] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1769.629242] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1769.632574] [] mount_fs+0x39/0x1b0 [ 1769.635378] [] vfs_kern_mount+0x67/0x110 [ 1769.639888] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1769.642141] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1769.644658] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1769.647038] [] obd_setup+0x167/0x540 [obdclass] [ 1769.649253] [] class_setup+0x54f/0x830 [obdclass] [ 1769.651303] [] class_process_config+0x149b/0x2660 [obdclass] [ 1769.653253] [] ? __kmalloc+0x1e0/0x340 [ 1769.657694] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1769.661278] [] do_lcfg+0x263/0x520 [obdclass] [ 1769.665359] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1769.669815] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1769.674195] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1769.678539] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1769.683139] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1769.688503] [] mount_nodev+0x4d/0xb0 [ 1769.693473] [] lustre_mount+0x18/0x20 [lustre] [ 1769.698626] [] mount_fs+0x39/0x1b0 [ 1769.702802] [] vfs_kern_mount+0x67/0x110 [ 1769.710432] [] do_mount+0x1ef/0xce0 [ 1769.718388] [] ? copy_mount_options+0x39/0x1b0 [ 1769.724176] [] SyS_mount+0x83/0xd0 [ 1769.725852] [] system_call_fastpath+0x1f/0x24 [ 1769.728181] LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5 [ 1769.734039] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1769.740440] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1769.778925] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1769.782894] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1769.788418] Call Trace: [ 1769.792096] [] dump_stack+0x19/0x1b [ 1769.796450] [] __schedule_bug+0x64/0x72 [ 1769.800348] [] __schedule+0x791/0x7d0 [ 1769.802092] [] ? bit_wait+0x50/0x50 [ 1769.805964] [] schedule+0x29/0x70 [ 1769.808973] [] schedule_timeout+0x209/0x290 [ 1769.813293] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1769.816270] [] ? kvm_clock_read+0x33/0x40 [ 1769.820271] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1769.823126] [] ? bit_wait+0x50/0x50 [ 1769.824881] [] io_schedule_timeout+0xad/0x130 [ 1769.829572] [] io_schedule+0x18/0x20 [ 1769.831354] [] bit_wait_io+0x11/0x50 [ 1769.838564] [] __wait_on_bit+0x65/0x90 [ 1769.840415] [] ? bit_wait+0x50/0x50 [ 1769.842223] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1769.844559] [] ? wake_bit_function+0x40/0x40 [ 1769.847435] [] __wait_on_buffer+0x2a/0x30 [ 1769.849772] [] __ldiskfs_get_inode_loc+0x1bd/0x400 [ldiskfs] [ 1769.854159] [] ldiskfs_iget+0x96/0xc60 [ldiskfs] [ 1769.863883] [] ? vprintk_emit+0x3e4/0x560 [ 1769.865834] [] ldiskfs_load_journal+0x19e/0x71c [ldiskfs] [ 1769.874498] [] ? printk+0x5d/0x74 [ 1769.880248] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1769.886515] [] mount_bdev+0x1b0/0x1f0 [ 1769.890280] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1769.894822] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1769.898061] [] mount_fs+0x39/0x1b0 [ 1769.900859] [] vfs_kern_mount+0x67/0x110 [ 1769.903283] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1769.907335] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1769.910546] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1769.916537] [] obd_setup+0x167/0x540 [obdclass] [ 1769.921226] [] class_setup+0x54f/0x830 [obdclass] [ 1769.926984] [] class_process_config+0x149b/0x2660 [obdclass] [ 1769.932715] [] ? __kmalloc+0x1e0/0x340 [ 1769.935742] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1769.939360] [] do_lcfg+0x263/0x520 [obdclass] [ 1769.947863] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1769.950488] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1769.952539] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1769.954668] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1769.959309] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1769.962182] [] mount_nodev+0x4d/0xb0 [ 1769.963802] [] lustre_mount+0x18/0x20 [lustre] [ 1769.966360] [] mount_fs+0x39/0x1b0 [ 1769.969314] [] vfs_kern_mount+0x67/0x110 [ 1769.972174] [] do_mount+0x1ef/0xce0 [ 1769.973714] [] ? copy_mount_options+0x39/0x1b0 [ 1769.975628] [] SyS_mount+0x83/0xd0 [ 1769.977983] [] system_call_fastpath+0x1f/0x24 [ 1769.980311] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1769.984571] in_atomic(): 1, irqs_disabled(): 0, pid: 32677, name: mount.lustre [ 1769.987449] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1769.993597] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1769.996796] Call Trace: [ 1769.997671] [] dump_stack+0x19/0x1b [ 1769.999760] [] __might_sleep+0xd9/0x100 [ 1770.002003] [] kmem_cache_alloc_trace+0x57/0x2e0 [ 1770.008412] [] ? unlock_new_inode+0x55/0x80 [ 1770.012342] [] ? journal_init_common+0x20/0x1b0 [jbd2] [ 1770.018561] [] ? ldiskfs_iget+0xab0/0xc60 [ldiskfs] [ 1770.021060] [] journal_init_common+0x20/0x1b0 [jbd2] [ 1770.025082] [] jbd2_journal_init_inode+0x29/0x1f0 [jbd2] [ 1770.028119] [] ldiskfs_load_journal+0x214/0x71c [ldiskfs] [ 1770.032076] [] ? printk+0x5d/0x74 [ 1770.036175] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1770.041979] [] mount_bdev+0x1b0/0x1f0 [ 1770.047062] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1770.054826] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1770.060527] [] mount_fs+0x39/0x1b0 [ 1770.066119] [] vfs_kern_mount+0x67/0x110 [ 1770.068189] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1770.071854] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1770.075882] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1770.081048] [] obd_setup+0x167/0x540 [obdclass] [ 1770.085627] [] class_setup+0x54f/0x830 [obdclass] [ 1770.088548] [] class_process_config+0x149b/0x2660 [obdclass] [ 1770.090860] [] ? __kmalloc+0x1e0/0x340 [ 1770.099990] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1770.103175] [] do_lcfg+0x263/0x520 [obdclass] [ 1770.106515] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1770.111701] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1770.117319] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1770.127972] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1770.135350] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1770.137535] [] mount_nodev+0x4d/0xb0 [ 1770.138926] [] lustre_mount+0x18/0x20 [lustre] [ 1770.146904] [] mount_fs+0x39/0x1b0 [ 1770.149252] [] vfs_kern_mount+0x67/0x110 [ 1770.151664] [] do_mount+0x1ef/0xce0 [ 1770.153637] [] ? copy_mount_options+0x39/0x1b0 [ 1770.156535] [] SyS_mount+0x83/0xd0 [ 1770.158428] [] system_call_fastpath+0x1f/0x24 [ 1770.160486] BUG: scheduling while atomic: mount.lustre/32677/0x10000002 [ 1770.164285] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1770.195158] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1770.199339] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1770.204884] Call Trace: [ 1770.205736] [] dump_stack+0x19/0x1b [ 1770.209366] [] __schedule_bug+0x64/0x72 [ 1770.213516] [] __schedule+0x791/0x7d0 [ 1770.217910] [] __cond_resched+0x26/0x30 [ 1770.220245] [] _cond_resched+0x3a/0x50 [ 1770.222379] [] kmem_cache_alloc_trace+0x5c/0x2e0 [ 1770.224603] [] ? unlock_new_inode+0x55/0x80 [ 1770.226866] [] ? journal_init_common+0x20/0x1b0 [jbd2] [ 1770.229198] [] ? ldiskfs_iget+0xab0/0xc60 [ldiskfs] [ 1770.231471] [] journal_init_common+0x20/0x1b0 [jbd2] [ 1770.241622] [] jbd2_journal_init_inode+0x29/0x1f0 [jbd2] [ 1770.250172] [] ldiskfs_load_journal+0x214/0x71c [ldiskfs] [ 1770.255015] [] ? printk+0x5d/0x74 [ 1770.257835] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1770.259873] [] mount_bdev+0x1b0/0x1f0 [ 1770.262277] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1770.265401] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1770.266585] [] mount_fs+0x39/0x1b0 [ 1770.268971] [] vfs_kern_mount+0x67/0x110 [ 1770.270680] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1770.274538] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1770.278385] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1770.281524] [] obd_setup+0x167/0x540 [obdclass] [ 1770.285104] [] class_setup+0x54f/0x830 [obdclass] [ 1770.288677] [] class_process_config+0x149b/0x2660 [obdclass] [ 1770.293330] [] ? __kmalloc+0x1e0/0x340 [ 1770.295157] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1770.300451] [] do_lcfg+0x263/0x520 [obdclass] [ 1770.303944] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1770.307484] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1770.311317] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1770.315649] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1770.320083] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1770.324950] [] mount_nodev+0x4d/0xb0 [ 1770.327931] [] lustre_mount+0x18/0x20 [lustre] [ 1770.331622] [] mount_fs+0x39/0x1b0 [ 1770.334906] [] vfs_kern_mount+0x67/0x110 [ 1770.337048] [] do_mount+0x1ef/0xce0 [ 1770.340476] [] ? copy_mount_options+0x39/0x1b0 [ 1770.346278] [] SyS_mount+0x83/0xd0 [ 1770.349442] [] system_call_fastpath+0x1f/0x24 [ 1770.354988] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1770.357574] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1770.403021] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1770.415949] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1770.423565] Call Trace: [ 1770.427781] [] dump_stack+0x19/0x1b [ 1770.433492] [] __schedule_bug+0x64/0x72 [ 1770.437303] [] __schedule+0x791/0x7d0 [ 1770.443646] [] ? bit_wait+0x50/0x50 [ 1770.450439] [] schedule+0x29/0x70 [ 1770.456692] [] schedule_timeout+0x209/0x290 [ 1770.465367] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1770.473781] [] ? kvm_clock_read+0x33/0x40 [ 1770.477876] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1770.484507] [] ? bit_wait+0x50/0x50 [ 1770.487322] [] io_schedule_timeout+0xad/0x130 [ 1770.490473] [] io_schedule+0x18/0x20 [ 1770.495813] [] bit_wait_io+0x11/0x50 [ 1770.498696] [] __wait_on_bit+0x65/0x90 [ 1770.501434] [] ? bit_wait+0x50/0x50 [ 1770.505305] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1770.509700] [] ? wake_bit_function+0x40/0x40 [ 1770.513168] [] __wait_on_buffer+0x2a/0x30 [ 1770.518950] [] journal_get_superblock+0x2c8/0x3a0 [jbd2] [ 1770.526654] [] jbd2_journal_wipe+0x20/0xb0 [jbd2] [ 1770.529748] [] ldiskfs_load_journal+0x5c5/0x71c [ldiskfs] [ 1770.533424] [] ? printk+0x5d/0x74 [ 1770.537904] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1770.541361] [] mount_bdev+0x1b0/0x1f0 [ 1770.544664] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1770.548922] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1770.552580] [] mount_fs+0x39/0x1b0 [ 1770.555166] [] vfs_kern_mount+0x67/0x110 [ 1770.559243] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1770.561475] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1770.566282] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1770.568882] [] obd_setup+0x167/0x540 [obdclass] [ 1770.570813] [] class_setup+0x54f/0x830 [obdclass] [ 1770.572709] [] class_process_config+0x149b/0x2660 [obdclass] [ 1770.574808] [] ? __kmalloc+0x1e0/0x340 [ 1770.579194] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1770.583337] [] do_lcfg+0x263/0x520 [obdclass] [ 1770.587861] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1770.592480] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1770.598188] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1770.601635] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1770.605594] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1770.609542] [] mount_nodev+0x4d/0xb0 [ 1770.613299] [] lustre_mount+0x18/0x20 [lustre] [ 1770.618999] [] mount_fs+0x39/0x1b0 [ 1770.621310] [] vfs_kern_mount+0x67/0x110 [ 1770.622882] [] do_mount+0x1ef/0xce0 [ 1770.625846] [] ? copy_mount_options+0x39/0x1b0 [ 1770.630217] [] SyS_mount+0x83/0xd0 [ 1770.632428] [] system_call_fastpath+0x1f/0x24 [ 1770.635713] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1770.637959] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1770.669430] CPU: 2 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1770.675270] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1770.678552] Call Trace: [ 1770.679454] [] dump_stack+0x19/0x1b [ 1770.683538] [] __schedule_bug+0x64/0x72 [ 1770.685588] [] __schedule+0x791/0x7d0 [ 1770.687479] [] schedule+0x29/0x70 [ 1770.690960] [] schedule_timeout+0x209/0x290 [ 1770.693565] [] ? native_smp_send_reschedule+0x4c/0x70 [ 1770.697050] [] ? resched_curr+0xd8/0xf0 [ 1770.699481] [] ? check_preempt_curr+0x80/0xa0 [ 1770.702874] [] ? ttwu_do_wakeup+0x19/0xf0 [ 1770.706421] [] wait_for_completion+0xfc/0x140 [ 1770.710800] [] ? wake_up_state+0x20/0x20 [ 1770.714394] [] kthread_create_on_node+0xa8/0x140 [ 1770.719292] [] ? bit_wait+0x50/0x50 [ 1770.722434] [] ? commit_timeout+0x10/0x10 [jbd2] [ 1770.730625] [] jbd2_journal_load+0x16b/0x2d0 [jbd2] [ 1770.735107] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1770.741402] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 1770.746074] [] ? printk+0x5d/0x74 [ 1770.748081] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1770.750198] [] mount_bdev+0x1b0/0x1f0 [ 1770.752162] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1770.756401] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1770.759567] [] mount_fs+0x39/0x1b0 [ 1770.761722] [] vfs_kern_mount+0x67/0x110 [ 1770.764934] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1770.769910] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1770.776564] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1770.778635] [] obd_setup+0x167/0x540 [obdclass] [ 1770.780605] [] class_setup+0x54f/0x830 [obdclass] [ 1770.783062] [] class_process_config+0x149b/0x2660 [obdclass] [ 1770.789972] [] ? __kmalloc+0x1e0/0x340 [ 1770.792000] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1770.794909] [] do_lcfg+0x263/0x520 [obdclass] [ 1770.799835] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1770.804326] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1770.806764] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1770.810453] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1770.813671] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1770.817106] [] mount_nodev+0x4d/0xb0 [ 1770.821421] [] lustre_mount+0x18/0x20 [lustre] [ 1770.824809] [] mount_fs+0x39/0x1b0 [ 1770.826567] [] vfs_kern_mount+0x67/0x110 [ 1770.828137] [] do_mount+0x1ef/0xce0 [ 1770.832160] [] ? copy_mount_options+0x39/0x1b0 [ 1770.834939] [] SyS_mount+0x83/0xd0 [ 1770.842915] [] system_call_fastpath+0x1f/0x24 [ 1770.849784] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1770.851507] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1770.887127] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1770.894959] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1770.899574] Call Trace: [ 1770.900303] [] dump_stack+0x19/0x1b [ 1770.903427] [] __schedule_bug+0x64/0x72 [ 1770.906770] [] __schedule+0x791/0x7d0 [ 1770.910477] [] schedule+0x29/0x70 [ 1770.912170] [] jbd2_journal_load+0x215/0x2d0 [jbd2] [ 1770.914484] [] ? wake_up_atomic_t+0x30/0x30 [ 1770.917451] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 1770.920914] [] ? printk+0x5d/0x74 [ 1770.924197] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1770.927052] [] mount_bdev+0x1b0/0x1f0 [ 1770.929857] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1770.935606] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1770.939678] [] mount_fs+0x39/0x1b0 [ 1770.941653] [] vfs_kern_mount+0x67/0x110 [ 1770.944330] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1770.948287] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1770.951869] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1770.954948] [] obd_setup+0x167/0x540 [obdclass] [ 1770.958123] [] class_setup+0x54f/0x830 [obdclass] [ 1770.961541] [] class_process_config+0x149b/0x2660 [obdclass] [ 1770.966180] [] ? __kmalloc+0x1e0/0x340 [ 1770.968258] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1770.974123] [] do_lcfg+0x263/0x520 [obdclass] [ 1770.976669] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1770.979973] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1770.983343] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1770.986551] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1770.988912] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1770.992638] [] mount_nodev+0x4d/0xb0 [ 1770.995141] [] lustre_mount+0x18/0x20 [lustre] [ 1770.997662] [] mount_fs+0x39/0x1b0 [ 1771.000255] [] vfs_kern_mount+0x67/0x110 [ 1771.005517] [] do_mount+0x1ef/0xce0 [ 1771.010321] [] ? copy_mount_options+0x39/0x1b0 [ 1771.017017] [] SyS_mount+0x83/0xd0 [ 1771.019310] [] system_call_fastpath+0x1f/0x24 [ 1771.024057] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1771.027940] in_atomic(): 1, irqs_disabled(): 0, pid: 32677, name: mount.lustre [ 1771.031107] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1771.036599] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1771.041174] Call Trace: [ 1771.042271] [] dump_stack+0x19/0x1b [ 1771.046700] [] __might_sleep+0xd9/0x100 [ 1771.049900] [] __kmalloc+0x73/0x340 [ 1771.053225] [] ? __debug_object_init+0x249/0x480 [ 1771.057824] [] ? __alloc_workqueue_key+0x261/0x480 [ 1771.062364] [] __alloc_workqueue_key+0x261/0x480 [ 1771.066489] [] ? do_raw_spin_unlock+0x49/0x90 [ 1771.071449] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 1771.079684] [] mount_bdev+0x1b0/0x1f0 [ 1771.085040] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1771.089699] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1771.097084] [] mount_fs+0x39/0x1b0 [ 1771.100016] [] vfs_kern_mount+0x67/0x110 [ 1771.102621] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1771.105910] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1771.108979] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1771.111957] [] obd_setup+0x167/0x540 [obdclass] [ 1771.115436] [] class_setup+0x54f/0x830 [obdclass] [ 1771.118589] [] class_process_config+0x149b/0x2660 [obdclass] [ 1771.121414] [] ? __kmalloc+0x1e0/0x340 [ 1771.123390] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1771.126492] [] do_lcfg+0x263/0x520 [obdclass] [ 1771.128907] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1771.132579] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1771.135403] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1771.138881] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1771.144903] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1771.150005] [] mount_nodev+0x4d/0xb0 [ 1771.155626] [] lustre_mount+0x18/0x20 [lustre] [ 1771.160821] [] mount_fs+0x39/0x1b0 [ 1771.164634] [] vfs_kern_mount+0x67/0x110 [ 1771.167467] [] do_mount+0x1ef/0xce0 [ 1771.169458] [] ? copy_mount_options+0x39/0x1b0 [ 1771.171548] [] SyS_mount+0x83/0xd0 [ 1771.175031] [] system_call_fastpath+0x1f/0x24 [ 1771.177509] BUG: scheduling while atomic: mount.lustre/32677/0x10000002 [ 1771.182329] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1771.214125] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1771.218536] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1771.223364] Call Trace: [ 1771.224436] [] dump_stack+0x19/0x1b [ 1771.226707] [] __schedule_bug+0x64/0x72 [ 1771.229527] [] __schedule+0x791/0x7d0 [ 1771.233880] [] __cond_resched+0x26/0x30 [ 1771.237404] [] _cond_resched+0x3a/0x50 [ 1771.241561] [] __kmalloc+0x78/0x340 [ 1771.243949] [] ? __debug_object_init+0x249/0x480 [ 1771.248402] [] ? __alloc_workqueue_key+0x261/0x480 [ 1771.253029] [] __alloc_workqueue_key+0x261/0x480 [ 1771.259139] [] ? do_raw_spin_unlock+0x49/0x90 [ 1771.267947] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 1771.272088] [] mount_bdev+0x1b0/0x1f0 [ 1771.275315] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1771.279564] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1771.284885] [] mount_fs+0x39/0x1b0 [ 1771.287076] [] vfs_kern_mount+0x67/0x110 [ 1771.290953] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1771.293846] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1771.297459] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1771.301781] [] obd_setup+0x167/0x540 [obdclass] [ 1771.306873] [] class_setup+0x54f/0x830 [obdclass] [ 1771.309931] [] class_process_config+0x149b/0x2660 [obdclass] [ 1771.313388] [] ? __kmalloc+0x1e0/0x340 [ 1771.317205] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1771.320878] [] do_lcfg+0x263/0x520 [obdclass] [ 1771.324995] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1771.327771] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1771.332197] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1771.335329] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1771.338601] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1771.341929] [] mount_nodev+0x4d/0xb0 [ 1771.346896] [] lustre_mount+0x18/0x20 [lustre] [ 1771.349674] [] mount_fs+0x39/0x1b0 [ 1771.354406] [] vfs_kern_mount+0x67/0x110 [ 1771.356284] [] do_mount+0x1ef/0xce0 [ 1771.358194] [] ? copy_mount_options+0x39/0x1b0 [ 1771.360623] [] SyS_mount+0x83/0xd0 [ 1771.362453] [] system_call_fastpath+0x1f/0x24 [ 1771.366065] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1771.368466] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1771.399033] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1771.408489] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1771.410944] Call Trace: [ 1771.411546] [] dump_stack+0x19/0x1b [ 1771.414006] [] __schedule_bug+0x64/0x72 [ 1771.418902] [] __schedule+0x791/0x7d0 [ 1771.421371] [] ? enqueue_entity+0x2ef/0xc30 [ 1771.426241] [] schedule+0x29/0x70 [ 1771.429927] [] schedule_timeout+0x209/0x290 [ 1771.432074] [] ? select_task_rq_fair+0x65c/0x780 [ 1771.434425] [] ? check_preempt_curr+0x80/0xa0 [ 1771.437511] [] ? ttwu_do_wakeup+0x19/0xf0 [ 1771.440879] [] wait_for_completion+0xfc/0x140 [ 1771.444000] [] ? wake_up_state+0x20/0x20 [ 1771.447884] [] kthread_create_on_node+0xa8/0x140 [ 1771.451266] [] ? process_one_work+0x4a0/0x4a0 [ 1771.453961] [] __alloc_workqueue_key+0x336/0x480 [ 1771.457371] [] ? do_raw_spin_unlock+0x49/0x90 [ 1771.459354] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 1771.464065] [] mount_bdev+0x1b0/0x1f0 [ 1771.467036] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1771.470109] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1771.472757] [] mount_fs+0x39/0x1b0 [ 1771.474846] [] vfs_kern_mount+0x67/0x110 [ 1771.479026] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1771.481995] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1771.486438] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1771.489229] [] obd_setup+0x167/0x540 [obdclass] [ 1771.493613] [] class_setup+0x54f/0x830 [obdclass] [ 1771.496123] [] class_process_config+0x149b/0x2660 [obdclass] [ 1771.499534] [] ? __kmalloc+0x1e0/0x340 [ 1771.503104] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1771.507242] [] do_lcfg+0x263/0x520 [obdclass] [ 1771.510186] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1771.513961] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1771.518368] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1771.522313] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1771.525919] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1771.528552] [] mount_nodev+0x4d/0xb0 [ 1771.531323] [] lustre_mount+0x18/0x20 [lustre] [ 1771.537031] [] mount_fs+0x39/0x1b0 [ 1771.540894] [] vfs_kern_mount+0x67/0x110 [ 1771.542945] [] do_mount+0x1ef/0xce0 [ 1771.549885] [] ? copy_mount_options+0x39/0x1b0 [ 1771.555238] [] SyS_mount+0x83/0xd0 [ 1771.561199] [] system_call_fastpath+0x1f/0x24 [ 1771.565853] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1771.569399] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1771.600408] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1771.604115] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1771.608833] Call Trace: [ 1771.610624] [] dump_stack+0x19/0x1b [ 1771.612774] [] __schedule_bug+0x64/0x72 [ 1771.615977] [] __schedule+0x791/0x7d0 [ 1771.619323] [] ? bit_wait+0x50/0x50 [ 1771.621256] [] schedule+0x29/0x70 [ 1771.623937] [] schedule_timeout+0x209/0x290 [ 1771.627321] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1771.630239] [] ? kvm_clock_read+0x33/0x40 [ 1771.633467] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1771.637267] [] ? ktime_get_ts64+0x4c/0xf0 [ 1771.639944] [] ? bit_wait+0x50/0x50 [ 1771.642239] [] io_schedule_timeout+0xad/0x130 [ 1771.644572] [] io_schedule+0x18/0x20 [ 1771.647326] [] bit_wait_io+0x11/0x50 [ 1771.650030] [] __wait_on_bit+0x65/0x90 [ 1771.652915] [] ? bit_wait+0x50/0x50 [ 1771.655138] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1771.657894] [] ? wake_bit_function+0x40/0x40 [ 1771.664117] [] __sync_dirty_buffer+0xe8/0x110 [ 1771.672825] [] sync_dirty_buffer+0x13/0x20 [ 1771.675508] [] ldiskfs_commit_super+0x1e0/0x280 [ldiskfs] [ 1771.683196] [] ldiskfs_setup_super+0x120/0x190 [ldiskfs] [ 1771.692384] [] ldiskfs_fill_super+0x2429/0x3060 [ldiskfs] [ 1771.694873] [] mount_bdev+0x1b0/0x1f0 [ 1771.697146] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1771.699947] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1771.705426] [] mount_fs+0x39/0x1b0 [ 1771.710143] [] vfs_kern_mount+0x67/0x110 [ 1771.723660] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1771.729061] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1771.735867] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1771.738328] [] obd_setup+0x167/0x540 [obdclass] [ 1771.740806] [] class_setup+0x54f/0x830 [obdclass] [ 1771.744043] [] class_process_config+0x149b/0x2660 [obdclass] [ 1771.746758] [] ? __kmalloc+0x1e0/0x340 [ 1771.748932] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1771.751469] [] do_lcfg+0x263/0x520 [obdclass] [ 1771.754324] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1771.757425] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1771.762110] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1771.766666] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1771.771357] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1771.773963] [] mount_nodev+0x4d/0xb0 [ 1771.777938] [] lustre_mount+0x18/0x20 [lustre] [ 1771.785414] [] mount_fs+0x39/0x1b0 [ 1771.788788] [] vfs_kern_mount+0x67/0x110 [ 1771.794360] [] do_mount+0x1ef/0xce0 [ 1771.798818] [] ? copy_mount_options+0x39/0x1b0 [ 1771.803686] [] SyS_mount+0x83/0xd0 [ 1771.807449] [] system_call_fastpath+0x1f/0x24 [ 1771.811942] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1771.818416] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1771.859166] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1771.872638] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1771.878031] Call Trace: [ 1771.879378] [] dump_stack+0x19/0x1b [ 1771.882377] [] __schedule_bug+0x64/0x72 [ 1771.886672] [] __schedule+0x791/0x7d0 [ 1771.890433] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1771.895911] [] ? bit_wait+0x50/0x50 [ 1771.900188] [] schedule+0x29/0x70 [ 1771.905273] [] schedule_timeout+0x209/0x290 [ 1771.907823] [] ? kvm_clock_read+0x33/0x40 [ 1771.909901] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1771.913190] [] ? ktime_get_ts64+0x4c/0xf0 [ 1771.917956] [] ? bit_wait+0x50/0x50 [ 1771.921664] [] io_schedule_timeout+0xad/0x130 [ 1771.927337] [] io_schedule+0x18/0x20 [ 1771.929082] [] bit_wait_io+0x11/0x50 [ 1771.934616] [] __wait_on_bit+0x65/0x90 [ 1771.939017] [] ? bit_wait+0x50/0x50 [ 1771.945535] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1771.947789] [] ? wake_bit_function+0x40/0x40 [ 1771.949385] [] __wait_on_buffer+0x2a/0x30 [ 1771.951154] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1771.965813] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1771.968050] [] v2_read_header+0x1f/0x50 [ 1771.969966] [] v2_check_quota_file+0x2b/0x70 [ 1771.972025] [] ? igrab+0x36/0x60 [ 1771.973787] [] vfs_load_quota_inode+0x279/0x570 [ 1771.976522] [] ? unlock_new_inode+0x55/0x80 [ 1771.978924] [] dquot_enable+0xf0/0x110 [ 1771.980877] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1771.983781] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1771.988136] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1771.992371] [] mount_bdev+0x1b0/0x1f0 [ 1771.999411] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1772.005210] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1772.009455] [] mount_fs+0x39/0x1b0 [ 1772.012366] [] vfs_kern_mount+0x67/0x110 [ 1772.014273] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1772.016634] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1772.021635] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1772.026513] [] obd_setup+0x167/0x540 [obdclass] [ 1772.031016] [] class_setup+0x54f/0x830 [obdclass] [ 1772.033080] [] class_process_config+0x149b/0x2660 [obdclass] [ 1772.035825] [] ? __kmalloc+0x1e0/0x340 [ 1772.038517] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1772.040665] [] do_lcfg+0x263/0x520 [obdclass] [ 1772.043783] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1772.047143] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1772.049820] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1772.052944] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1772.055913] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1772.058111] [] mount_nodev+0x4d/0xb0 [ 1772.062056] [] lustre_mount+0x18/0x20 [lustre] [ 1772.065387] [] mount_fs+0x39/0x1b0 [ 1772.067770] [] vfs_kern_mount+0x67/0x110 [ 1772.069967] [] do_mount+0x1ef/0xce0 [ 1772.073675] [] ? copy_mount_options+0x39/0x1b0 [ 1772.077030] [] SyS_mount+0x83/0xd0 [ 1772.080176] [] system_call_fastpath+0x1f/0x24 [ 1772.082592] BUG: sleeping function called from invalid context at kernel/mutex.c:104 [ 1772.085372] in_atomic(): 1, irqs_disabled(): 0, pid: 32677, name: mount.lustre [ 1772.089921] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1772.094645] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1772.098868] Call Trace: [ 1772.099735] [] dump_stack+0x19/0x1b [ 1772.103554] [] __might_sleep+0xd9/0x100 [ 1772.107416] [] mutex_lock+0x20/0x40 [ 1772.109149] [] vfs_load_quota_inode+0x2d8/0x570 [ 1772.111344] [] dquot_enable+0xf0/0x110 [ 1772.115631] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1772.123006] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1772.128671] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1772.138058] [] mount_bdev+0x1b0/0x1f0 [ 1772.142278] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1772.147219] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1772.155625] [] mount_fs+0x39/0x1b0 [ 1772.161495] [] vfs_kern_mount+0x67/0x110 [ 1772.169335] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1772.176411] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1772.182344] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1772.189569] [] obd_setup+0x167/0x540 [obdclass] [ 1772.196707] [] class_setup+0x54f/0x830 [obdclass] [ 1772.201641] [] class_process_config+0x149b/0x2660 [obdclass] [ 1772.206010] [] ? __kmalloc+0x1e0/0x340 [ 1772.208444] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1772.217667] [] do_lcfg+0x263/0x520 [obdclass] [ 1772.220131] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1772.223985] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1772.231606] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1772.236196] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1772.238396] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1772.240472] [] mount_nodev+0x4d/0xb0 [ 1772.243281] [] lustre_mount+0x18/0x20 [lustre] [ 1772.251710] [] mount_fs+0x39/0x1b0 [ 1772.253613] [] vfs_kern_mount+0x67/0x110 [ 1772.258387] [] do_mount+0x1ef/0xce0 [ 1772.261179] [] ? copy_mount_options+0x39/0x1b0 [ 1772.265128] [] SyS_mount+0x83/0xd0 [ 1772.268018] [] system_call_fastpath+0x1f/0x24 [ 1772.274859] BUG: scheduling while atomic: mount.lustre/32677/0x10000002 [ 1772.276903] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1772.339077] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1772.344690] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1772.348982] Call Trace: [ 1772.351686] [] dump_stack+0x19/0x1b [ 1772.354213] [] __schedule_bug+0x64/0x72 [ 1772.361383] [] __schedule+0x791/0x7d0 [ 1772.367096] [] __cond_resched+0x26/0x30 [ 1772.370705] [] _cond_resched+0x3a/0x50 [ 1772.372647] [] mutex_lock+0x25/0x40 [ 1772.374348] [] vfs_load_quota_inode+0x2d8/0x570 [ 1772.376768] [] dquot_enable+0xf0/0x110 [ 1772.378230] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1772.381285] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1772.383560] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1772.389047] [] mount_bdev+0x1b0/0x1f0 [ 1772.391194] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1772.393822] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1772.398590] [] mount_fs+0x39/0x1b0 [ 1772.400889] [] vfs_kern_mount+0x67/0x110 [ 1772.404581] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1772.408594] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1772.412472] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1772.415088] [] obd_setup+0x167/0x540 [obdclass] [ 1772.417096] [] class_setup+0x54f/0x830 [obdclass] [ 1772.419351] [] class_process_config+0x149b/0x2660 [obdclass] [ 1772.421988] [] ? __kmalloc+0x1e0/0x340 [ 1772.424081] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1772.429617] [] do_lcfg+0x263/0x520 [obdclass] [ 1772.436262] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1772.446924] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1772.451309] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1772.457756] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1772.462328] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1772.464834] [] mount_nodev+0x4d/0xb0 [ 1772.469227] [] lustre_mount+0x18/0x20 [lustre] [ 1772.471677] [] mount_fs+0x39/0x1b0 [ 1772.474245] [] vfs_kern_mount+0x67/0x110 [ 1772.477858] [] do_mount+0x1ef/0xce0 [ 1772.479722] [] ? copy_mount_options+0x39/0x1b0 [ 1772.481762] [] SyS_mount+0x83/0xd0 [ 1772.483504] [] system_call_fastpath+0x1f/0x24 [ 1772.485692] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1772.487860] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1772.526173] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1772.533275] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1772.538506] Call Trace: [ 1772.541073] [] dump_stack+0x19/0x1b [ 1772.543532] [] __schedule_bug+0x64/0x72 [ 1772.546523] [] __schedule+0x791/0x7d0 [ 1772.550082] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1772.553661] [] ? bit_wait+0x50/0x50 [ 1772.558016] [] schedule+0x29/0x70 [ 1772.560723] [] schedule_timeout+0x209/0x290 [ 1772.566681] [] ? kvm_clock_read+0x33/0x40 [ 1772.568745] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1772.570886] [] ? ktime_get_ts64+0x4c/0xf0 [ 1772.572869] [] ? bit_wait+0x50/0x50 [ 1772.574655] [] io_schedule_timeout+0xad/0x130 [ 1772.576698] [] io_schedule+0x18/0x20 [ 1772.578473] [] bit_wait_io+0x11/0x50 [ 1772.580060] [] __wait_on_bit+0x65/0x90 [ 1772.581672] [] ? bit_wait+0x50/0x50 [ 1772.583330] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1772.585496] [] ? wake_bit_function+0x40/0x40 [ 1772.590537] [] __wait_on_buffer+0x2a/0x30 [ 1772.594561] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1772.599171] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1772.604138] [] v2_read_header+0x1f/0x50 [ 1772.608468] [] v2_check_quota_file+0x2b/0x70 [ 1772.613672] [] ? igrab+0x36/0x60 [ 1772.617339] [] vfs_load_quota_inode+0x279/0x570 [ 1772.622485] [] ? unlock_new_inode+0x55/0x80 [ 1772.627583] [] dquot_enable+0xf0/0x110 [ 1772.632594] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1772.635592] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1772.641131] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1772.644702] [] mount_bdev+0x1b0/0x1f0 [ 1772.648323] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1772.652883] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1772.656803] [] mount_fs+0x39/0x1b0 [ 1772.659840] [] vfs_kern_mount+0x67/0x110 [ 1772.664479] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1772.669878] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1772.672977] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1772.676852] [] obd_setup+0x167/0x540 [obdclass] [ 1772.680907] [] class_setup+0x54f/0x830 [obdclass] [ 1772.683721] [] class_process_config+0x149b/0x2660 [obdclass] [ 1772.688161] [] ? __kmalloc+0x1e0/0x340 [ 1772.690667] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1772.695159] [] do_lcfg+0x263/0x520 [obdclass] [ 1772.700363] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1772.705386] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1772.709336] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1772.715007] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1772.718162] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1772.721984] [] mount_nodev+0x4d/0xb0 [ 1772.724412] [] lustre_mount+0x18/0x20 [lustre] [ 1772.728424] [] mount_fs+0x39/0x1b0 [ 1772.731165] [] vfs_kern_mount+0x67/0x110 [ 1772.734028] [] do_mount+0x1ef/0xce0 [ 1772.736356] [] ? copy_mount_options+0x39/0x1b0 [ 1772.741694] [] SyS_mount+0x83/0xd0 [ 1772.747807] [] system_call_fastpath+0x1f/0x24 [ 1772.749906] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1772.751971] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1772.790575] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1772.798564] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1772.805479] Call Trace: [ 1772.807491] [] dump_stack+0x19/0x1b [ 1772.809836] [] __schedule_bug+0x64/0x72 [ 1772.822869] [] __schedule+0x791/0x7d0 [ 1772.827873] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1772.838499] [] ? bit_wait+0x50/0x50 [ 1772.843937] [] schedule+0x29/0x70 [ 1772.848401] [] schedule_timeout+0x209/0x290 [ 1772.857470] [] ? kvm_clock_read+0x33/0x40 [ 1772.863261] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1772.865269] [] ? ktime_get_ts64+0x4c/0xf0 [ 1772.869768] [] ? bit_wait+0x50/0x50 [ 1772.873402] [] io_schedule_timeout+0xad/0x130 [ 1772.875593] [] io_schedule+0x18/0x20 [ 1772.877531] [] bit_wait_io+0x11/0x50 [ 1772.880687] [] __wait_on_bit+0x65/0x90 [ 1772.882856] [] ? bit_wait+0x50/0x50 [ 1772.885011] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1772.887879] [] ? wake_bit_function+0x40/0x40 [ 1772.894801] [] __wait_on_buffer+0x2a/0x30 [ 1772.897880] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1772.912147] [] ? mark_page_accessed+0xd8/0xe0 [ 1772.915016] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1772.917718] [] v2_read_header+0x1f/0x50 [ 1772.927528] [] v2_check_quota_file+0x2b/0x70 [ 1772.935813] [] ? igrab+0x36/0x60 [ 1772.941239] [] vfs_load_quota_inode+0x279/0x570 [ 1772.945634] [] ? unlock_new_inode+0x55/0x80 [ 1772.948935] [] dquot_enable+0xf0/0x110 [ 1772.952163] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1772.954539] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1772.957224] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1772.959696] [] mount_bdev+0x1b0/0x1f0 [ 1772.963173] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1772.965187] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1772.966970] [] mount_fs+0x39/0x1b0 [ 1772.970951] [] vfs_kern_mount+0x67/0x110 [ 1772.975589] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1772.980262] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1772.984891] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1772.991773] [] obd_setup+0x167/0x540 [obdclass] [ 1772.999817] [] class_setup+0x54f/0x830 [obdclass] [ 1773.005989] [] class_process_config+0x149b/0x2660 [obdclass] [ 1773.014331] [] ? __kmalloc+0x1e0/0x340 [ 1773.023322] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1773.027995] [] do_lcfg+0x263/0x520 [obdclass] [ 1773.035890] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1773.039443] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1773.047838] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1773.055207] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1773.057917] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1773.062707] [] mount_nodev+0x4d/0xb0 [ 1773.065912] [] lustre_mount+0x18/0x20 [lustre] [ 1773.068512] [] mount_fs+0x39/0x1b0 [ 1773.070499] [] vfs_kern_mount+0x67/0x110 [ 1773.072680] [] do_mount+0x1ef/0xce0 [ 1773.075853] [] ? copy_mount_options+0x39/0x1b0 [ 1773.078868] [] SyS_mount+0x83/0xd0 [ 1773.082646] [] system_call_fastpath+0x1f/0x24 [ 1773.087095] BUG: sleeping function called from invalid context at kernel/mutex.c:104 [ 1773.089986] in_atomic(): 1, irqs_disabled(): 0, pid: 32677, name: mount.lustre [ 1773.092360] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1773.096807] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1773.099863] Call Trace: [ 1773.100794] [] dump_stack+0x19/0x1b [ 1773.102876] [] __might_sleep+0xd9/0x100 [ 1773.105202] [] mutex_lock+0x20/0x40 [ 1773.109984] [] vfs_load_quota_inode+0x2d8/0x570 [ 1773.112393] [] dquot_enable+0xf0/0x110 [ 1773.114676] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1773.118277] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1773.122971] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1773.125905] [] mount_bdev+0x1b0/0x1f0 [ 1773.129050] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1773.132417] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1773.135462] [] mount_fs+0x39/0x1b0 [ 1773.139296] [] vfs_kern_mount+0x67/0x110 [ 1773.142019] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1773.145817] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1773.149692] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1773.154368] [] obd_setup+0x167/0x540 [obdclass] [ 1773.162072] [] class_setup+0x54f/0x830 [obdclass] [ 1773.167999] [] class_process_config+0x149b/0x2660 [obdclass] [ 1773.171737] [] ? __kmalloc+0x1e0/0x340 [ 1773.173183] LustreError: 15393:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1773.173185] LustreError: 15393:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 5 previous similar messages [ 1773.191066] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1773.193473] [] do_lcfg+0x263/0x520 [obdclass] [ 1773.195895] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1773.202199] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1773.205550] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1773.210652] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1773.214547] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1773.217221] [] mount_nodev+0x4d/0xb0 [ 1773.219128] [] lustre_mount+0x18/0x20 [lustre] [ 1773.220931] [] mount_fs+0x39/0x1b0 [ 1773.222813] [] vfs_kern_mount+0x67/0x110 [ 1773.225004] [] do_mount+0x1ef/0xce0 [ 1773.227744] [] ? copy_mount_options+0x39/0x1b0 [ 1773.231120] [] SyS_mount+0x83/0xd0 [ 1773.233428] [] system_call_fastpath+0x1f/0x24 [ 1773.235859] BUG: scheduling while atomic: mount.lustre/32677/0x10000002 [ 1773.238814] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1773.274119] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1773.288347] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1773.293058] Call Trace: [ 1773.296173] [] dump_stack+0x19/0x1b [ 1773.300351] [] __schedule_bug+0x64/0x72 [ 1773.306728] [] __schedule+0x791/0x7d0 [ 1773.308708] [] __cond_resched+0x26/0x30 [ 1773.313684] [] _cond_resched+0x3a/0x50 [ 1773.317585] [] mutex_lock+0x25/0x40 [ 1773.322130] [] vfs_load_quota_inode+0x2d8/0x570 [ 1773.326165] [] dquot_enable+0xf0/0x110 [ 1773.328295] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1773.330412] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1773.333491] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1773.335725] [] mount_bdev+0x1b0/0x1f0 [ 1773.337393] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1773.340268] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1773.342595] [] mount_fs+0x39/0x1b0 [ 1773.344335] [] vfs_kern_mount+0x67/0x110 [ 1773.349566] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1773.353935] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1773.358301] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1773.361846] [] obd_setup+0x167/0x540 [obdclass] [ 1773.367181] [] class_setup+0x54f/0x830 [obdclass] [ 1773.369377] [] class_process_config+0x149b/0x2660 [obdclass] [ 1773.376541] [] ? __kmalloc+0x1e0/0x340 [ 1773.380870] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1773.386123] [] do_lcfg+0x263/0x520 [obdclass] [ 1773.389326] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1773.394002] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1773.398468] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1773.401396] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1773.405272] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1773.408126] [] mount_nodev+0x4d/0xb0 [ 1773.412842] [] lustre_mount+0x18/0x20 [lustre] [ 1773.417056] [] mount_fs+0x39/0x1b0 [ 1773.420306] [] vfs_kern_mount+0x67/0x110 [ 1773.423085] [] do_mount+0x1ef/0xce0 [ 1773.425792] [] ? copy_mount_options+0x39/0x1b0 [ 1773.429608] [] SyS_mount+0x83/0xd0 [ 1773.432610] [] system_call_fastpath+0x1f/0x24 [ 1773.438195] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1773.444886] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1773.447578] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1773.490235] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1773.496298] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1773.502577] Call Trace: [ 1773.504958] [] dump_stack+0x19/0x1b [ 1773.508917] [] __schedule_bug+0x64/0x72 [ 1773.511663] [] __schedule+0x791/0x7d0 [ 1773.514123] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1773.520247] [] ? bit_wait+0x50/0x50 [ 1773.523972] [] schedule+0x29/0x70 [ 1773.533149] [] schedule_timeout+0x209/0x290 [ 1773.537825] [] ? kvm_clock_read+0x33/0x40 [ 1773.543070] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1773.545504] [] ? ktime_get_ts64+0x4c/0xf0 [ 1773.548631] [] ? bit_wait+0x50/0x50 [ 1773.550827] [] io_schedule_timeout+0xad/0x130 [ 1773.554967] [] io_schedule+0x18/0x20 [ 1773.557112] [] bit_wait_io+0x11/0x50 [ 1773.562192] [] __wait_on_bit+0x65/0x90 [ 1773.576216] [] ? bit_wait+0x50/0x50 [ 1773.578874] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1773.582908] [] ? wake_bit_function+0x40/0x40 [ 1773.585367] [] __wait_on_buffer+0x2a/0x30 [ 1773.587722] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1773.591625] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1773.595831] [] read_blk+0x4c/0x60 [ 1773.598917] [] find_tree_dqentry+0x47/0x240 [ 1773.602516] [] find_tree_dqentry+0x1aa/0x240 [ 1773.605814] [] find_tree_dqentry+0x1aa/0x240 [ 1773.608899] [] find_tree_dqentry+0x1aa/0x240 [ 1773.613378] [] qtree_read_dquot+0x14c/0x380 [ 1773.617039] [] v2_read_dquot+0x2b/0x30 [ 1773.624085] [] dquot_acquire+0xe4/0x130 [ 1773.627174] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1773.630551] [] dqget+0x3fb/0x460 [ 1773.633075] [] __dquot_initialize+0x12d/0x230 [ 1773.635601] [] ? free_pages.part.76+0x40/0x50 [ 1773.638073] [] dquot_initialize+0x13/0x20 [ 1773.640001] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1773.642590] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1773.645611] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1773.648673] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1773.652030] [] obd_setup+0x167/0x540 [obdclass] [ 1773.654381] [] class_setup+0x54f/0x830 [obdclass] [ 1773.657548] [] class_process_config+0x149b/0x2660 [obdclass] [ 1773.661138] [] ? __kmalloc+0x1e0/0x340 [ 1773.664471] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1773.667479] [] do_lcfg+0x263/0x520 [obdclass] [ 1773.671846] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1773.675339] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1773.681368] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1773.683790] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1773.685945] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1773.688154] [] mount_nodev+0x4d/0xb0 [ 1773.689942] [] lustre_mount+0x18/0x20 [lustre] [ 1773.691901] [] mount_fs+0x39/0x1b0 [ 1773.693592] [] vfs_kern_mount+0x67/0x110 [ 1773.695533] [] do_mount+0x1ef/0xce0 [ 1773.697402] [] ? copy_mount_options+0x39/0x1b0 [ 1773.699201] [] SyS_mount+0x83/0xd0 [ 1773.703628] [] system_call_fastpath+0x1f/0x24 [ 1773.708380] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1773.710285] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1773.741733] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1773.748209] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1773.754065] Call Trace: [ 1773.755066] [] dump_stack+0x19/0x1b [ 1773.757600] [] __schedule_bug+0x64/0x72 [ 1773.761535] [] __schedule+0x791/0x7d0 [ 1773.762991] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1773.768674] [] ? bit_wait+0x50/0x50 [ 1773.770135] [] schedule+0x29/0x70 [ 1773.772337] [] schedule_timeout+0x209/0x290 [ 1773.776929] [] ? kvm_clock_read+0x33/0x40 [ 1773.780238] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1773.782843] [] ? ktime_get_ts64+0x4c/0xf0 [ 1773.784878] [] ? bit_wait+0x50/0x50 [ 1773.788627] [] io_schedule_timeout+0xad/0x130 [ 1773.790837] [] io_schedule+0x18/0x20 [ 1773.792779] [] bit_wait_io+0x11/0x50 [ 1773.794699] [] __wait_on_bit+0x65/0x90 [ 1773.798947] [] ? bit_wait+0x50/0x50 [ 1773.801218] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1773.813905] [] ? wake_bit_function+0x40/0x40 [ 1773.816168] [] __wait_on_buffer+0x2a/0x30 [ 1773.818288] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1773.823164] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1773.836197] [] read_blk+0x4c/0x60 [ 1773.839174] [] find_tree_dqentry+0x47/0x240 [ 1773.843465] [] find_tree_dqentry+0x1aa/0x240 [ 1773.846775] [] find_tree_dqentry+0x1aa/0x240 [ 1773.849624] [] find_tree_dqentry+0x1aa/0x240 [ 1773.852715] [] qtree_read_dquot+0x14c/0x380 [ 1773.857521] [] v2_read_dquot+0x2b/0x30 [ 1773.863020] [] dquot_acquire+0xe4/0x130 [ 1773.868570] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1773.874066] [] dqget+0x3fb/0x460 [ 1773.879277] [] __dquot_initialize+0x12d/0x230 [ 1773.882848] [] dquot_initialize+0x13/0x20 [ 1773.890335] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1773.897500] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1773.903365] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1773.910233] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1773.913617] [] obd_setup+0x167/0x540 [obdclass] [ 1773.915745] [] class_setup+0x54f/0x830 [obdclass] [ 1773.919462] [] class_process_config+0x149b/0x2660 [obdclass] [ 1773.922164] [] ? __kmalloc+0x1e0/0x340 [ 1773.927315] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1773.931252] [] do_lcfg+0x263/0x520 [obdclass] [ 1773.935878] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1773.941542] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1773.946899] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1773.952606] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1773.957668] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1773.966726] [] mount_nodev+0x4d/0xb0 [ 1773.968584] [] lustre_mount+0x18/0x20 [lustre] [ 1773.970808] [] mount_fs+0x39/0x1b0 [ 1773.986217] [] vfs_kern_mount+0x67/0x110 [ 1773.988284] [] do_mount+0x1ef/0xce0 [ 1773.995835] [] ? copy_mount_options+0x39/0x1b0 [ 1773.999861] [] SyS_mount+0x83/0xd0 [ 1774.004853] [] system_call_fastpath+0x1f/0x24 [ 1774.006576] BUG: scheduling while atomic: mount.lustre/32677/0x00000002 [ 1774.008872] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1774.039765] CPU: 1 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1774.044263] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1774.048097] Call Trace: [ 1774.050567] [] dump_stack+0x19/0x1b [ 1774.054696] [] __schedule_bug+0x64/0x72 [ 1774.072042] [] __schedule+0x791/0x7d0 [ 1774.075639] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1774.078603] [] ? bit_wait+0x50/0x50 [ 1774.080254] [] schedule+0x29/0x70 [ 1774.082685] [] schedule_timeout+0x209/0x290 [ 1774.087153] [] ? kvm_clock_read+0x33/0x40 [ 1774.092530] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1774.094872] [] ? ktime_get_ts64+0x4c/0xf0 [ 1774.099030] [] ? bit_wait+0x50/0x50 [ 1774.100893] [] io_schedule_timeout+0xad/0x130 [ 1774.103579] [] io_schedule+0x18/0x20 [ 1774.105659] [] bit_wait_io+0x11/0x50 [ 1774.107559] [] __wait_on_bit+0x65/0x90 [ 1774.109073] [] ? bit_wait+0x50/0x50 [ 1774.111580] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1774.114021] [] ? wake_bit_function+0x40/0x40 [ 1774.116522] [] __wait_on_buffer+0x2a/0x30 [ 1774.118573] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1774.121125] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1774.125494] [] read_blk+0x4c/0x60 [ 1774.127372] [] find_tree_dqentry+0x47/0x240 [ 1774.130169] [] find_tree_dqentry+0x1aa/0x240 [ 1774.132387] [] find_tree_dqentry+0x1aa/0x240 [ 1774.135223] [] find_tree_dqentry+0x1aa/0x240 [ 1774.137464] [] qtree_read_dquot+0x14c/0x380 [ 1774.140948] [] v2_read_dquot+0x2b/0x30 [ 1774.145950] [] dquot_acquire+0xe4/0x130 [ 1774.147763] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1774.149981] [] dqget+0x3fb/0x460 [ 1774.151650] [] __dquot_initialize+0x12d/0x230 [ 1774.153681] [] dquot_initialize+0x13/0x20 [ 1774.155378] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1774.160153] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1774.162860] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1774.170083] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1774.174068] [] obd_setup+0x167/0x540 [obdclass] [ 1774.178944] [] class_setup+0x54f/0x830 [obdclass] [ 1774.183694] [] class_process_config+0x149b/0x2660 [obdclass] [ 1774.188227] [] ? __kmalloc+0x1e0/0x340 [ 1774.191967] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1774.195101] [] do_lcfg+0x263/0x520 [obdclass] [ 1774.200201] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1774.204067] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1774.206827] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1774.210611] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1774.214482] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1774.216696] [] mount_nodev+0x4d/0xb0 [ 1774.221247] [] lustre_mount+0x18/0x20 [lustre] [ 1774.228812] [] mount_fs+0x39/0x1b0 [ 1774.231681] [] vfs_kern_mount+0x67/0x110 [ 1774.237137] [] do_mount+0x1ef/0xce0 [ 1774.241818] [] ? copy_mount_options+0x39/0x1b0 [ 1774.247879] [] SyS_mount+0x83/0xd0 [ 1774.250170] [] system_call_fastpath+0x1f/0x24 [ 1774.253108] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1774.255836] in_atomic(): 1, irqs_disabled(): 0, pid: 32677, name: mount.lustre [ 1774.258053] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1774.268438] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1774.280649] Call Trace: [ 1774.282759] [] dump_stack+0x19/0x1b [ 1774.287769] [] __might_sleep+0xd9/0x100 [ 1774.291226] [] __kmalloc+0x73/0x340 [ 1774.295111] [] ? getdqbuf+0x14/0x40 [ 1774.300783] [] getdqbuf+0x14/0x40 [ 1774.303850] [] find_tree_dqentry+0xaf/0x240 [ 1774.309760] [] find_tree_dqentry+0x1aa/0x240 [ 1774.315725] [] find_tree_dqentry+0x1aa/0x240 [ 1774.320465] [] find_tree_dqentry+0x1aa/0x240 [ 1774.322681] [] qtree_read_dquot+0x14c/0x380 [ 1774.326871] [] v2_read_dquot+0x2b/0x30 [ 1774.329579] [] dquot_acquire+0xe4/0x130 [ 1774.331449] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1774.333850] [] dqget+0x3fb/0x460 [ 1774.335507] [] __dquot_initialize+0x12d/0x230 [ 1774.337551] [] dquot_initialize+0x13/0x20 [ 1774.339580] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1774.341960] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1774.355072] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1774.362985] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1774.368530] [] obd_setup+0x167/0x540 [obdclass] [ 1774.372309] [] class_setup+0x54f/0x830 [obdclass] [ 1774.386901] [] class_process_config+0x149b/0x2660 [obdclass] [ 1774.391357] [] ? __kmalloc+0x1e0/0x340 [ 1774.395844] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1774.398618] [] do_lcfg+0x263/0x520 [obdclass] [ 1774.402075] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1774.406917] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1774.411760] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1774.415484] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1774.422863] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1774.426476] [] mount_nodev+0x4d/0xb0 [ 1774.428179] [] lustre_mount+0x18/0x20 [lustre] [ 1774.430109] [] mount_fs+0x39/0x1b0 [ 1774.431665] [] vfs_kern_mount+0x67/0x110 [ 1774.433635] [] do_mount+0x1ef/0xce0 [ 1774.435229] [] ? copy_mount_options+0x39/0x1b0 [ 1774.437139] [] SyS_mount+0x83/0xd0 [ 1774.438928] [] system_call_fastpath+0x1f/0x24 [ 1774.443946] BUG: scheduling while atomic: mount.lustre/32677/0x10000002 [ 1774.456414] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1774.495442] CPU: 0 PID: 32677 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1774.501894] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1774.513917] Call Trace: [ 1774.515893] [] dump_stack+0x19/0x1b [ 1774.520640] [] __schedule_bug+0x64/0x72 [ 1774.525863] [] __schedule+0x791/0x7d0 [ 1774.527742] [] __cond_resched+0x26/0x30 [ 1774.533379] [] _cond_resched+0x3a/0x50 [ 1774.537909] [] __kmalloc+0x78/0x340 [ 1774.541209] [] ? getdqbuf+0x14/0x40 [ 1774.543110] [] getdqbuf+0x14/0x40 [ 1774.549894] [] find_tree_dqentry+0xaf/0x240 [ 1774.552801] [] find_tree_dqentry+0x1aa/0x240 [ 1774.558249] [] find_tree_dqentry+0x1aa/0x240 [ 1774.564562] [] find_tree_dqentry+0x1aa/0x240 [ 1774.570993] [] qtree_read_dquot+0x14c/0x380 [ 1774.577347] [] v2_read_dquot+0x2b/0x30 [ 1774.583792] [] dquot_acquire+0xe4/0x130 [ 1774.588925] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1774.593766] [] dqget+0x3fb/0x460 [ 1774.599316] [] __dquot_initialize+0x12d/0x230 [ 1774.606675] [] dquot_initialize+0x13/0x20 [ 1774.613023] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1774.616393] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1774.621521] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1774.625698] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1774.632099] [] obd_setup+0x167/0x540 [obdclass] [ 1774.634815] [] class_setup+0x54f/0x830 [obdclass] [ 1774.638046] [] class_process_config+0x149b/0x2660 [obdclass] [ 1774.642265] [] ? __kmalloc+0x1e0/0x340 [ 1774.645782] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1774.647763] [] do_lcfg+0x263/0x520 [obdclass] [ 1774.652619] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1774.656006] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1774.659888] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1774.663309] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1774.667804] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1774.670367] [] mount_nodev+0x4d/0xb0 [ 1774.675558] [] lustre_mount+0x18/0x20 [lustre] [ 1774.677898] [] mount_fs+0x39/0x1b0 [ 1774.680059] [] vfs_kern_mount+0x67/0x110 [ 1774.683278] [] do_mount+0x1ef/0xce0 [ 1774.686129] [] ? copy_mount_options+0x39/0x1b0 [ 1774.689759] [] SyS_mount+0x83/0xd0 [ 1774.691837] [] system_call_fastpath+0x1f/0x24 [ 1774.938133] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1774.957864] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1776.057260] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1776.620631] Lustre: lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. [ 1776.621425] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 192.168.204.113@tcp (at 0@lo) [ 1776.621426] Lustre: Skipped 1 previous similar message [ 1778.212155] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1782.310361] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1784.966271] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1787.659997] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1790.217828] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1792.584324] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1795.008717] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1818.337629] Lustre: DEBUG MARKER: == sanity-quota test 7c: Quota reintegration (restart mds during reintegration) ========================================================== 07:43:32 (1750592612) [ 1831.049891] LustreError: 5050:0:(qsd_reint.c:620:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed. [ 1831.055519] LustreError: 5050:0:(qsd_reint.c:620:qqi_reint_delayed()) Skipped 17 previous similar messages [ 1834.064208] LustreError: 5296:0:(qsd_reint.c:477:qsd_reint_main()) cfs_fail_timeout id a03 sleeping for 10000ms [ 1834.075672] LustreError: 5296:0:(qsd_reint.c:477:qsd_reint_main()) Skipped 5 previous similar messages [ 1835.258507] Lustre: Failing over lustre-MDT0000 [ 1835.413190] LustreError: 5431:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 1835.422507] LustreError: 5431:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1835.480416] Lustre: server umount lustre-MDT0000 complete [ 1837.731821] LustreError: 5300:0:(qsd_reint.c:477:qsd_reint_main()) cfs_fail_timeout interrupted [ 1837.734333] LustreError: lustre-MDT0000-lwp-OST0000: operation dt_index_read to node 0@lo failed: rc = -107 [ 1837.734348] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1837.734350] Lustre: Skipped 1 previous similar message [ 1837.737842] LustreError: 7239:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1837.737844] LustreError: 7239:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 2 previous similar messages [ 1837.792846] LustreError: 5300:0:(qsd_reint.c:477:qsd_reint_main()) Skipped 5 previous similar messages [ 1841.895857] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1841.903780] in_atomic(): 1, irqs_disabled(): 0, pid: 6093, name: mount.lustre [ 1841.912913] CPU: 1 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1841.927576] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1841.936911] Call Trace: [ 1841.942098] [] dump_stack+0x19/0x1b [ 1841.944061] [] __might_sleep+0xd9/0x100 [ 1841.946082] [] kmem_cache_alloc+0x4f/0x2e0 [ 1841.950808] [] alloc_vfsmnt+0x24/0x240 [ 1841.963055] [] vfs_kern_mount+0x36/0x110 [ 1841.969843] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1841.977630] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1841.981214] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1841.991161] [] obd_setup+0x167/0x540 [obdclass] [ 1841.994715] [] class_setup+0x54f/0x830 [obdclass] [ 1841.998477] [] class_process_config+0x149b/0x2660 [obdclass] [ 1842.004069] [] ? __kmalloc+0x1e0/0x340 [ 1842.008039] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1842.010570] [] do_lcfg+0x263/0x520 [obdclass] [ 1842.013009] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1842.015310] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1842.019071] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1842.021928] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1842.024166] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1842.026722] [] mount_nodev+0x4d/0xb0 [ 1842.028827] [] lustre_mount+0x18/0x20 [lustre] [ 1842.031584] [] mount_fs+0x39/0x1b0 [ 1842.033853] [] vfs_kern_mount+0x67/0x110 [ 1842.038429] [] do_mount+0x1ef/0xce0 [ 1842.040882] [] ? copy_mount_options+0x39/0x1b0 [ 1842.043318] [] SyS_mount+0x83/0xd0 [ 1842.046497] [] system_call_fastpath+0x1f/0x24 [ 1842.054024] BUG: scheduling while atomic: mount.lustre/6093/0x10000002 [ 1842.055769] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1842.094388] CPU: 1 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1842.100089] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1842.108298] Call Trace: [ 1842.109418] [] dump_stack+0x19/0x1b [ 1842.111902] [] __schedule_bug+0x64/0x72 [ 1842.114256] [] __schedule+0x791/0x7d0 [ 1842.116339] [] ? alloc_vfsmnt+0x24/0x240 [ 1842.118543] [] __cond_resched+0x26/0x30 [ 1842.121925] [] _cond_resched+0x3a/0x50 [ 1842.125463] [] kmem_cache_alloc+0x54/0x2e0 [ 1842.129638] [] alloc_vfsmnt+0x24/0x240 [ 1842.132129] [] vfs_kern_mount+0x36/0x110 [ 1842.141050] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1842.148047] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1842.156183] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1842.162816] [] obd_setup+0x167/0x540 [obdclass] [ 1842.164604] [] class_setup+0x54f/0x830 [obdclass] [ 1842.166194] [] class_process_config+0x149b/0x2660 [obdclass] [ 1842.168298] [] ? __kmalloc+0x1e0/0x340 [ 1842.180403] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1842.186968] [] do_lcfg+0x263/0x520 [obdclass] [ 1842.193048] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1842.200166] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1842.207278] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1842.216855] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1842.221077] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1842.225558] [] mount_nodev+0x4d/0xb0 [ 1842.227588] [] lustre_mount+0x18/0x20 [lustre] [ 1842.229658] [] mount_fs+0x39/0x1b0 [ 1842.231289] [] vfs_kern_mount+0x67/0x110 [ 1842.233162] [] do_mount+0x1ef/0xce0 [ 1842.234806] [] ? copy_mount_options+0x39/0x1b0 [ 1842.236650] [] SyS_mount+0x83/0xd0 [ 1842.238408] [] system_call_fastpath+0x1f/0x24 [ 1842.272240] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1842.277366] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1842.305475] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1842.311689] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1842.314911] Call Trace: [ 1842.315813] [] dump_stack+0x19/0x1b [ 1842.317583] [] __schedule_bug+0x64/0x72 [ 1842.321388] [] __schedule+0x791/0x7d0 [ 1842.326906] [] ? bit_wait+0x50/0x50 [ 1842.332842] [] schedule+0x29/0x70 [ 1842.338249] [] schedule_timeout+0x209/0x290 [ 1842.341642] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1842.344017] [] ? kvm_clock_read+0x33/0x40 [ 1842.348988] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1842.355470] [] ? bit_wait+0x50/0x50 [ 1842.360376] [] io_schedule_timeout+0xad/0x130 [ 1842.368814] [] io_schedule+0x18/0x20 [ 1842.370791] [] bit_wait_io+0x11/0x50 [ 1842.372644] [] __wait_on_bit+0x65/0x90 [ 1842.374498] [] ? bit_wait+0x50/0x50 [ 1842.376156] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1842.378065] [] ? wake_bit_function+0x40/0x40 [ 1842.382801] [] __wait_on_buffer+0x2a/0x30 [ 1842.388545] [] __ldiskfs_get_inode_loc+0x1bd/0x400 [ldiskfs] [ 1842.396069] [] ldiskfs_iget+0x96/0xc60 [ldiskfs] [ 1842.399986] [] ldiskfs_load_journal+0x19e/0x71c [ldiskfs] [ 1842.403419] [] ? do_raw_spin_unlock+0x49/0x90 [ 1842.408594] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1842.413253] [] mount_bdev+0x1b0/0x1f0 [ 1842.416369] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1842.421561] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1842.423775] [] mount_fs+0x39/0x1b0 [ 1842.425484] [] vfs_kern_mount+0x67/0x110 [ 1842.427495] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1842.429620] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1842.431353] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1842.432985] [] obd_setup+0x167/0x540 [obdclass] [ 1842.435106] [] class_setup+0x54f/0x830 [obdclass] [ 1842.437335] [] class_process_config+0x149b/0x2660 [obdclass] [ 1842.439921] [] ? __kmalloc+0x1e0/0x340 [ 1842.441834] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1842.443988] [] do_lcfg+0x263/0x520 [obdclass] [ 1842.445802] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1842.447811] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1842.450141] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1842.452667] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1842.458030] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1842.462495] [] mount_nodev+0x4d/0xb0 [ 1842.468623] [] lustre_mount+0x18/0x20 [lustre] [ 1842.472802] [] mount_fs+0x39/0x1b0 [ 1842.476539] [] vfs_kern_mount+0x67/0x110 [ 1842.480533] [] do_mount+0x1ef/0xce0 [ 1842.484552] [] ? copy_mount_options+0x39/0x1b0 [ 1842.490252] [] SyS_mount+0x83/0xd0 [ 1842.495548] [] system_call_fastpath+0x1f/0x24 [ 1842.498902] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1842.502921] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1842.527638] CPU: 1 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1842.533485] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1842.535780] Call Trace: [ 1842.536593] [] dump_stack+0x19/0x1b [ 1842.538137] [] __schedule_bug+0x64/0x72 [ 1842.539917] [] __schedule+0x791/0x7d0 [ 1842.541627] [] ? bit_wait+0x50/0x50 [ 1842.546686] [] schedule+0x29/0x70 [ 1842.550308] [] schedule_timeout+0x209/0x290 [ 1842.554479] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1842.557044] [] ? kvm_clock_read+0x33/0x40 [ 1842.558946] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1842.560723] [] ? bit_wait+0x50/0x50 [ 1842.562248] [] io_schedule_timeout+0xad/0x130 [ 1842.563858] [] io_schedule+0x18/0x20 [ 1842.565462] [] bit_wait_io+0x11/0x50 [ 1842.567083] [] __wait_on_bit+0x65/0x90 [ 1842.568893] [] ? bit_wait+0x50/0x50 [ 1842.570672] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1842.572662] [] ? wake_bit_function+0x40/0x40 [ 1842.579009] [] __wait_on_buffer+0x2a/0x30 [ 1842.583157] [] journal_get_superblock+0x2c8/0x3a0 [jbd2] [ 1842.596586] [] jbd2_journal_wipe+0x20/0xb0 [jbd2] [ 1842.601321] [] ldiskfs_load_journal+0x5c5/0x71c [ldiskfs] [ 1842.604719] [] ? do_raw_spin_unlock+0x49/0x90 [ 1842.610105] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1842.612063] [] mount_bdev+0x1b0/0x1f0 [ 1842.614479] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1842.622391] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1842.626980] [] mount_fs+0x39/0x1b0 [ 1842.631231] [] vfs_kern_mount+0x67/0x110 [ 1842.633035] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1842.634955] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1842.637375] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1842.639809] [] obd_setup+0x167/0x540 [obdclass] [ 1842.641694] [] class_setup+0x54f/0x830 [obdclass] [ 1842.646945] [] class_process_config+0x149b/0x2660 [obdclass] [ 1842.660393] [] ? __kmalloc+0x1e0/0x340 [ 1842.670916] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1842.676159] [] do_lcfg+0x263/0x520 [obdclass] [ 1842.686403] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1842.691883] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1842.697658] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1842.711045] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1842.721040] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1842.722792] [] mount_nodev+0x4d/0xb0 [ 1842.724105] [] lustre_mount+0x18/0x20 [lustre] [ 1842.725609] [] mount_fs+0x39/0x1b0 [ 1842.726817] [] vfs_kern_mount+0x67/0x110 [ 1842.728133] [] do_mount+0x1ef/0xce0 [ 1842.729366] [] ? copy_mount_options+0x39/0x1b0 [ 1842.730863] [] SyS_mount+0x83/0xd0 [ 1842.735253] [] system_call_fastpath+0x1f/0x24 [ 1842.738151] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1842.741651] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1842.780870] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1842.793137] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1842.796339] Call Trace: [ 1842.798034] [] dump_stack+0x19/0x1b [ 1842.799913] [] __schedule_bug+0x64/0x72 [ 1842.802680] [] __schedule+0x791/0x7d0 [ 1842.806358] [] ? enqueue_entity+0x2ef/0xc30 [ 1842.809058] [] schedule+0x29/0x70 [ 1842.812300] [] schedule_timeout+0x209/0x290 [ 1842.814290] [] ? sched_clock_cpu+0xa5/0xe0 [ 1842.816189] [] ? check_preempt_curr+0x80/0xa0 [ 1842.817696] [] ? ttwu_do_wakeup+0x19/0xf0 [ 1842.819204] [] wait_for_completion+0xfc/0x140 [ 1842.820690] [] ? wake_up_state+0x20/0x20 [ 1842.822024] [] kthread_create_on_node+0xa8/0x140 [ 1842.823747] [] ? bit_wait+0x50/0x50 [ 1842.825455] [] ? commit_timeout+0x10/0x10 [jbd2] [ 1842.831183] [] jbd2_journal_load+0x16b/0x2d0 [jbd2] [ 1842.837539] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 1842.842922] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 1842.848218] [] ? do_raw_spin_unlock+0x49/0x90 [ 1842.850359] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1842.854365] [] mount_bdev+0x1b0/0x1f0 [ 1842.857449] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1842.860938] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1842.863220] [] mount_fs+0x39/0x1b0 [ 1842.865285] [] vfs_kern_mount+0x67/0x110 [ 1842.868423] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1842.873000] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1842.876368] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1842.880753] [] obd_setup+0x167/0x540 [obdclass] [ 1842.885363] [] class_setup+0x54f/0x830 [obdclass] [ 1842.889264] [] class_process_config+0x149b/0x2660 [obdclass] [ 1842.892476] [] ? __kmalloc+0x1e0/0x340 [ 1842.895220] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1842.899558] [] do_lcfg+0x263/0x520 [obdclass] [ 1842.902434] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1842.908237] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1842.915540] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1842.919695] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1842.923707] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1842.926845] [] mount_nodev+0x4d/0xb0 [ 1842.930305] [] lustre_mount+0x18/0x20 [lustre] [ 1842.932946] [] mount_fs+0x39/0x1b0 [ 1842.934325] [] vfs_kern_mount+0x67/0x110 [ 1842.937039] [] do_mount+0x1ef/0xce0 [ 1842.941515] [] ? copy_mount_options+0x39/0x1b0 [ 1842.943796] [] SyS_mount+0x83/0xd0 [ 1842.947310] [] system_call_fastpath+0x1f/0x24 [ 1842.953017] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1842.958825] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1843.022059] CPU: 1 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1843.039073] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1843.052936] Call Trace: [ 1843.056564] [] dump_stack+0x19/0x1b [ 1843.062253] [] __schedule_bug+0x64/0x72 [ 1843.068881] [] __schedule+0x791/0x7d0 [ 1843.074299] [] schedule+0x29/0x70 [ 1843.080582] [] jbd2_journal_load+0x215/0x2d0 [jbd2] [ 1843.089516] [] ? wake_up_atomic_t+0x30/0x30 [ 1843.096827] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 1843.104108] [] ? do_raw_spin_unlock+0x49/0x90 [ 1843.105901] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 1843.114338] [] mount_bdev+0x1b0/0x1f0 [ 1843.117501] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1843.122091] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1843.127096] [] mount_fs+0x39/0x1b0 [ 1843.128967] [] vfs_kern_mount+0x67/0x110 [ 1843.131371] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1843.134647] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1843.136702] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1843.138631] [] obd_setup+0x167/0x540 [obdclass] [ 1843.140466] [] class_setup+0x54f/0x830 [obdclass] [ 1843.142263] [] class_process_config+0x149b/0x2660 [obdclass] [ 1843.144318] [] ? __kmalloc+0x1e0/0x340 [ 1843.145905] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1843.150484] [] do_lcfg+0x263/0x520 [obdclass] [ 1843.154541] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1843.160368] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1843.166050] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1843.170491] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1843.179436] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1843.183020] [] mount_nodev+0x4d/0xb0 [ 1843.184934] [] lustre_mount+0x18/0x20 [lustre] [ 1843.189645] [] mount_fs+0x39/0x1b0 [ 1843.193592] [] vfs_kern_mount+0x67/0x110 [ 1843.195710] [] do_mount+0x1ef/0xce0 [ 1843.199115] [] ? copy_mount_options+0x39/0x1b0 [ 1843.202504] [] SyS_mount+0x83/0xd0 [ 1843.205367] [] system_call_fastpath+0x1f/0x24 [ 1843.209062] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1843.213571] in_atomic(): 1, irqs_disabled(): 0, pid: 6093, name: mount.lustre [ 1843.216384] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1843.220960] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1843.225673] Call Trace: [ 1843.226586] [] dump_stack+0x19/0x1b [ 1843.230931] [] __might_sleep+0xd9/0x100 [ 1843.233200] [] __kmalloc+0x73/0x340 [ 1843.236469] [] ? __debug_object_init+0x249/0x480 [ 1843.239133] [] ? __alloc_workqueue_key+0x261/0x480 [ 1843.243622] [] __alloc_workqueue_key+0x261/0x480 [ 1843.247896] [] ? do_raw_spin_unlock+0x49/0x90 [ 1843.251675] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 1843.255349] [] mount_bdev+0x1b0/0x1f0 [ 1843.258213] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1843.263058] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1843.271991] [] mount_fs+0x39/0x1b0 [ 1843.277633] [] vfs_kern_mount+0x67/0x110 [ 1843.279606] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1843.282727] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1843.286393] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1843.291001] [] obd_setup+0x167/0x540 [obdclass] [ 1843.294584] [] class_setup+0x54f/0x830 [obdclass] [ 1843.298487] [] class_process_config+0x149b/0x2660 [obdclass] [ 1843.303079] [] ? __kmalloc+0x1e0/0x340 [ 1843.309093] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1843.316086] [] do_lcfg+0x263/0x520 [obdclass] [ 1843.321709] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1843.324282] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1843.326669] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1843.329556] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1843.332624] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1843.336106] [] mount_nodev+0x4d/0xb0 [ 1843.339176] [] lustre_mount+0x18/0x20 [lustre] [ 1843.342380] [] mount_fs+0x39/0x1b0 [ 1843.344874] [] vfs_kern_mount+0x67/0x110 [ 1843.347319] [] do_mount+0x1ef/0xce0 [ 1843.349121] [] ? copy_mount_options+0x39/0x1b0 [ 1843.352299] [] SyS_mount+0x83/0xd0 [ 1843.354763] [] system_call_fastpath+0x1f/0x24 [ 1843.359945] BUG: scheduling while atomic: mount.lustre/6093/0x10000002 [ 1843.362145] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1843.399102] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1843.406717] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1843.417505] Call Trace: [ 1843.418490] [] dump_stack+0x19/0x1b [ 1843.422343] [] __schedule_bug+0x64/0x72 [ 1843.425506] [] __schedule+0x791/0x7d0 [ 1843.428025] [] __cond_resched+0x26/0x30 [ 1843.430326] [] _cond_resched+0x3a/0x50 [ 1843.437323] [] __kmalloc+0x78/0x340 [ 1843.438894] [] ? __debug_object_init+0x249/0x480 [ 1843.442788] [] ? __alloc_workqueue_key+0x261/0x480 [ 1843.446234] [] __alloc_workqueue_key+0x261/0x480 [ 1843.449739] [] ? do_raw_spin_unlock+0x49/0x90 [ 1843.453466] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 1843.457878] [] mount_bdev+0x1b0/0x1f0 [ 1843.460842] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1843.466396] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1843.469122] [] mount_fs+0x39/0x1b0 [ 1843.470453] [] vfs_kern_mount+0x67/0x110 [ 1843.471906] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1843.473630] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1843.476026] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1843.478303] [] obd_setup+0x167/0x540 [obdclass] [ 1843.480098] [] class_setup+0x54f/0x830 [obdclass] [ 1843.481577] [] class_process_config+0x149b/0x2660 [obdclass] [ 1843.483190] [] ? __kmalloc+0x1e0/0x340 [ 1843.484442] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1843.485815] [] do_lcfg+0x263/0x520 [obdclass] [ 1843.487198] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1843.488830] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1843.490404] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1843.492016] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1843.493520] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1843.494988] [] mount_nodev+0x4d/0xb0 [ 1843.496240] [] lustre_mount+0x18/0x20 [lustre] [ 1843.497633] [] mount_fs+0x39/0x1b0 [ 1843.501105] [] vfs_kern_mount+0x67/0x110 [ 1843.503153] [] do_mount+0x1ef/0xce0 [ 1843.508467] [] ? copy_mount_options+0x39/0x1b0 [ 1843.516022] [] SyS_mount+0x83/0xd0 [ 1843.520268] [] system_call_fastpath+0x1f/0x24 [ 1843.524308] BUG: scheduling while atomic: mount.lustre/6093/0x10000002 [ 1843.525914] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1843.553803] CPU: 1 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1843.558994] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1843.564386] Call Trace: [ 1843.565641] [] dump_stack+0x19/0x1b [ 1843.568280] [] __schedule_bug+0x64/0x72 [ 1843.570864] [] __schedule+0x791/0x7d0 [ 1843.573294] [] __cond_resched+0x26/0x30 [ 1843.575881] [] _cond_resched+0x3a/0x50 [ 1843.580012] [] wait_for_completion+0x42/0x140 [ 1843.582554] [] ? do_raw_spin_unlock+0x49/0x90 [ 1843.584949] [] kthread_create_on_node+0xa8/0x140 [ 1843.588565] [] ? process_one_work+0x4a0/0x4a0 [ 1843.591555] [] __alloc_workqueue_key+0x336/0x480 [ 1843.594722] [] ? do_raw_spin_unlock+0x49/0x90 [ 1843.598830] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 1843.601862] [] mount_bdev+0x1b0/0x1f0 [ 1843.605617] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1843.608120] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1843.610088] [] mount_fs+0x39/0x1b0 [ 1843.611762] [] vfs_kern_mount+0x67/0x110 [ 1843.616050] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1843.620086] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1843.625153] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1843.628522] [] obd_setup+0x167/0x540 [obdclass] [ 1843.634056] [] class_setup+0x54f/0x830 [obdclass] [ 1843.637648] [] class_process_config+0x149b/0x2660 [obdclass] [ 1843.643025] [] ? __kmalloc+0x1e0/0x340 [ 1843.645509] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1843.647870] [] do_lcfg+0x263/0x520 [obdclass] [ 1843.656019] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1843.660802] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1843.663225] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1843.665736] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1843.668052] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1843.670453] [] mount_nodev+0x4d/0xb0 [ 1843.673936] [] lustre_mount+0x18/0x20 [lustre] [ 1843.677595] [] mount_fs+0x39/0x1b0 [ 1843.683856] [] vfs_kern_mount+0x67/0x110 [ 1843.686467] [] do_mount+0x1ef/0xce0 [ 1843.697836] [] ? copy_mount_options+0x39/0x1b0 [ 1843.700602] [] SyS_mount+0x83/0xd0 [ 1843.703254] [] system_call_fastpath+0x1f/0x24 [ 1843.708989] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1843.722632] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1843.765007] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1843.770613] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1843.775479] Call Trace: [ 1843.776491] [] dump_stack+0x19/0x1b [ 1843.778347] [] __schedule_bug+0x64/0x72 [ 1843.780348] [] __schedule+0x791/0x7d0 [ 1843.782305] [] ? bit_wait+0x50/0x50 [ 1843.786579] [] schedule+0x29/0x70 [ 1843.790335] [] schedule_timeout+0x209/0x290 [ 1843.794176] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 1843.797599] [] ? kvm_clock_read+0x33/0x40 [ 1843.802158] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1843.804294] [] ? ktime_get_ts64+0x4c/0xf0 [ 1843.806922] [] ? bit_wait+0x50/0x50 [ 1843.810982] [] io_schedule_timeout+0xad/0x130 [ 1843.814053] [] io_schedule+0x18/0x20 [ 1843.816548] [] bit_wait_io+0x11/0x50 [ 1843.820182] [] __wait_on_bit+0x65/0x90 [ 1843.824248] [] ? bit_wait+0x50/0x50 [ 1843.827555] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1843.831156] [] ? wake_bit_function+0x40/0x40 [ 1843.834408] [] __sync_dirty_buffer+0xe8/0x110 [ 1843.836373] [] sync_dirty_buffer+0x13/0x20 [ 1843.841859] [] ldiskfs_commit_super+0x1e0/0x280 [ldiskfs] [ 1843.844238] [] ldiskfs_setup_super+0x120/0x190 [ldiskfs] [ 1843.846399] [] ldiskfs_fill_super+0x2429/0x3060 [ldiskfs] [ 1843.848508] [] mount_bdev+0x1b0/0x1f0 [ 1843.853942] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1843.858128] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1843.862871] [] mount_fs+0x39/0x1b0 [ 1843.864994] [] vfs_kern_mount+0x67/0x110 [ 1843.871060] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1843.873715] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1843.877811] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1843.880727] [] obd_setup+0x167/0x540 [obdclass] [ 1843.882822] [] class_setup+0x54f/0x830 [obdclass] [ 1843.885055] [] class_process_config+0x149b/0x2660 [obdclass] [ 1843.887491] [] ? __kmalloc+0x1e0/0x340 [ 1843.889185] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1843.891328] [] do_lcfg+0x263/0x520 [obdclass] [ 1843.893167] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1843.895675] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1843.902958] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1843.908760] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1843.914675] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1843.924262] [] mount_nodev+0x4d/0xb0 [ 1843.927941] [] lustre_mount+0x18/0x20 [lustre] [ 1843.934392] [] mount_fs+0x39/0x1b0 [ 1843.941630] [] vfs_kern_mount+0x67/0x110 [ 1843.947914] [] do_mount+0x1ef/0xce0 [ 1843.955589] [] ? copy_mount_options+0x39/0x1b0 [ 1843.963266] [] SyS_mount+0x83/0xd0 [ 1843.966642] [] system_call_fastpath+0x1f/0x24 [ 1843.980100] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1843.991522] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1844.023655] CPU: 2 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1844.030603] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1844.034903] Call Trace: [ 1844.035793] [] dump_stack+0x19/0x1b [ 1844.039687] [] __schedule_bug+0x64/0x72 [ 1844.047821] [] __schedule+0x791/0x7d0 [ 1844.054260] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1844.058522] [] ? bit_wait+0x50/0x50 [ 1844.062438] [] schedule+0x29/0x70 [ 1844.064969] [] schedule_timeout+0x209/0x290 [ 1844.067007] [] ? kvm_clock_read+0x33/0x40 [ 1844.069115] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1844.075738] [] ? ktime_get_ts64+0x4c/0xf0 [ 1844.078489] [] ? bit_wait+0x50/0x50 [ 1844.080770] [] io_schedule_timeout+0xad/0x130 [ 1844.083183] [] io_schedule+0x18/0x20 [ 1844.087427] [] bit_wait_io+0x11/0x50 [ 1844.090928] [] __wait_on_bit+0x65/0x90 [ 1844.094880] [] ? bit_wait+0x50/0x50 [ 1844.099771] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1844.107305] [] ? wake_bit_function+0x40/0x40 [ 1844.109544] [] __wait_on_buffer+0x2a/0x30 [ 1844.112569] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1844.115391] [] ? mark_page_accessed+0xd8/0xe0 [ 1844.119041] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1844.121693] [] v2_read_header+0x1f/0x50 [ 1844.123798] [] v2_check_quota_file+0x2b/0x70 [ 1844.126088] [] ? igrab+0x36/0x60 [ 1844.127995] [] vfs_load_quota_inode+0x279/0x570 [ 1844.133282] [] ? unlock_new_inode+0x55/0x80 [ 1844.135290] [] dquot_enable+0xf0/0x110 [ 1844.141009] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1844.146548] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1844.148905] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1844.151512] [] mount_bdev+0x1b0/0x1f0 [ 1844.153374] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1844.157857] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1844.164330] [] mount_fs+0x39/0x1b0 [ 1844.166309] [] vfs_kern_mount+0x67/0x110 [ 1844.172616] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1844.176668] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1844.181416] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1844.186763] [] obd_setup+0x167/0x540 [obdclass] [ 1844.189592] [] class_setup+0x54f/0x830 [obdclass] [ 1844.192267] [] class_process_config+0x149b/0x2660 [obdclass] [ 1844.194742] [] ? __kmalloc+0x1e0/0x340 [ 1844.196581] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1844.198747] [] do_lcfg+0x263/0x520 [obdclass] [ 1844.201879] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1844.206108] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1844.209866] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1844.213862] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1844.218764] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1844.222369] [] mount_nodev+0x4d/0xb0 [ 1844.224299] [] lustre_mount+0x18/0x20 [lustre] [ 1844.226522] [] mount_fs+0x39/0x1b0 [ 1844.230891] [] vfs_kern_mount+0x67/0x110 [ 1844.234417] [] do_mount+0x1ef/0xce0 [ 1844.238164] [] ? copy_mount_options+0x39/0x1b0 [ 1844.244089] [] SyS_mount+0x83/0xd0 [ 1844.249938] [] system_call_fastpath+0x1f/0x24 [ 1844.253940] BUG: sleeping function called from invalid context at kernel/mutex.c:104 [ 1844.260267] in_atomic(): 1, irqs_disabled(): 0, pid: 6093, name: mount.lustre [ 1844.264865] CPU: 2 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1844.269855] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1844.275535] Call Trace: [ 1844.279532] [] dump_stack+0x19/0x1b [ 1844.281673] [] __might_sleep+0xd9/0x100 [ 1844.285292] [] mutex_lock+0x20/0x40 [ 1844.286955] [] vfs_load_quota_inode+0x2d8/0x570 [ 1844.289964] [] dquot_enable+0xf0/0x110 [ 1844.291874] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1844.294873] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1844.297797] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1844.301462] [] mount_bdev+0x1b0/0x1f0 [ 1844.304141] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1844.307437] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1844.311025] [] mount_fs+0x39/0x1b0 [ 1844.313756] [] vfs_kern_mount+0x67/0x110 [ 1844.315950] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1844.321316] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1844.328151] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1844.332892] [] obd_setup+0x167/0x540 [obdclass] [ 1844.336876] [] class_setup+0x54f/0x830 [obdclass] [ 1844.341442] [] class_process_config+0x149b/0x2660 [obdclass] [ 1844.346172] [] ? __kmalloc+0x1e0/0x340 [ 1844.352509] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1844.356077] [] do_lcfg+0x263/0x520 [obdclass] [ 1844.358805] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1844.362126] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1844.364395] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1844.370348] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1844.373941] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1844.378394] [] mount_nodev+0x4d/0xb0 [ 1844.380218] [] lustre_mount+0x18/0x20 [lustre] [ 1844.382102] [] mount_fs+0x39/0x1b0 [ 1844.387903] [] vfs_kern_mount+0x67/0x110 [ 1844.391953] [] do_mount+0x1ef/0xce0 [ 1844.393844] [] ? copy_mount_options+0x39/0x1b0 [ 1844.398685] [] SyS_mount+0x83/0xd0 [ 1844.401036] [] system_call_fastpath+0x1f/0x24 [ 1844.402837] BUG: scheduling while atomic: mount.lustre/6093/0x10000002 [ 1844.404554] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1844.432313] CPU: 2 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1844.441614] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1844.452944] Call Trace: [ 1844.454398] [] dump_stack+0x19/0x1b [ 1844.457617] [] __schedule_bug+0x64/0x72 [ 1844.459831] [] __schedule+0x791/0x7d0 [ 1844.462269] [] __cond_resched+0x26/0x30 [ 1844.464931] [] _cond_resched+0x3a/0x50 [ 1844.466641] [] mutex_lock+0x25/0x40 [ 1844.468332] [] vfs_load_quota_inode+0x2d8/0x570 [ 1844.470406] [] dquot_enable+0xf0/0x110 [ 1844.473838] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1844.476434] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1844.486852] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1844.495269] [] mount_bdev+0x1b0/0x1f0 [ 1844.503274] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1844.505839] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1844.511842] [] mount_fs+0x39/0x1b0 [ 1844.522815] [] vfs_kern_mount+0x67/0x110 [ 1844.524776] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1844.533614] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1844.539166] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1844.543120] [] obd_setup+0x167/0x540 [obdclass] [ 1844.546763] [] class_setup+0x54f/0x830 [obdclass] [ 1844.552418] [] class_process_config+0x149b/0x2660 [obdclass] [ 1844.556370] [] ? __kmalloc+0x1e0/0x340 [ 1844.561917] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1844.568713] [] do_lcfg+0x263/0x520 [obdclass] [ 1844.577561] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1844.580911] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1844.584212] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1844.588553] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1844.595130] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1844.599073] [] mount_nodev+0x4d/0xb0 [ 1844.604579] [] lustre_mount+0x18/0x20 [lustre] [ 1844.606294] [] mount_fs+0x39/0x1b0 [ 1844.609841] [] vfs_kern_mount+0x67/0x110 [ 1844.619069] [] do_mount+0x1ef/0xce0 [ 1844.624881] [] ? copy_mount_options+0x39/0x1b0 [ 1844.631862] [] SyS_mount+0x83/0xd0 [ 1844.633307] [] system_call_fastpath+0x1f/0x24 [ 1844.634962] BUG: scheduling while atomic: mount.lustre/6093/0x10000002 [ 1844.637504] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1844.709068] CPU: 3 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1844.728795] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1844.732264] Call Trace: [ 1844.735127] [] dump_stack+0x19/0x1b [ 1844.739895] [] __schedule_bug+0x64/0x72 [ 1844.744049] [] __schedule+0x791/0x7d0 [ 1844.745627] [] __cond_resched+0x26/0x30 [ 1844.747246] [] _cond_resched+0x3a/0x50 [ 1844.748984] [] __getblk+0x40/0x300 [ 1844.770358] [] ldiskfs_getblk+0xa1/0x210 [ldiskfs] [ 1844.776891] [] ldiskfs_bread+0x27/0xe0 [ldiskfs] [ 1844.784859] [] ? do_raw_spin_unlock+0x49/0x90 [ 1844.787470] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1844.796173] [] v2_read_header+0x1f/0x50 [ 1844.803059] [] v2_read_file_info+0x41/0x1d0 [ 1844.805143] [] vfs_load_quota_inode+0x2f0/0x570 [ 1844.814980] [] dquot_enable+0xf0/0x110 [ 1844.823723] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1844.827779] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1844.830994] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1844.834573] [] mount_bdev+0x1b0/0x1f0 [ 1844.836678] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1844.839654] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1844.842874] [] mount_fs+0x39/0x1b0 [ 1844.844616] [] vfs_kern_mount+0x67/0x110 [ 1844.846999] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1844.849096] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1844.853134] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1844.855276] [] obd_setup+0x167/0x540 [obdclass] [ 1844.859309] [] class_setup+0x54f/0x830 [obdclass] [ 1844.861494] [] class_process_config+0x149b/0x2660 [obdclass] [ 1844.863864] [] ? __kmalloc+0x1e0/0x340 [ 1844.868590] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1844.871764] [] do_lcfg+0x263/0x520 [obdclass] [ 1844.877662] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1844.880049] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1844.882384] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1844.884237] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1844.886370] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1844.890823] [] mount_nodev+0x4d/0xb0 [ 1844.906304] [] lustre_mount+0x18/0x20 [lustre] [ 1844.908821] [] mount_fs+0x39/0x1b0 [ 1844.910757] [] vfs_kern_mount+0x67/0x110 [ 1844.912833] [] do_mount+0x1ef/0xce0 [ 1844.914673] [] ? copy_mount_options+0x39/0x1b0 [ 1844.916834] [] SyS_mount+0x83/0xd0 [ 1844.918733] [] system_call_fastpath+0x1f/0x24 [ 1844.921165] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1844.922811] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1844.944609] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1844.948450] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1844.952564] Call Trace: [ 1844.954087] [] dump_stack+0x19/0x1b [ 1844.957312] [] __schedule_bug+0x64/0x72 [ 1844.959807] [] __schedule+0x791/0x7d0 [ 1844.961438] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1844.964300] [] ? bit_wait+0x50/0x50 [ 1844.966113] [] schedule+0x29/0x70 [ 1844.969360] [] schedule_timeout+0x209/0x290 [ 1844.970874] [] ? kvm_clock_read+0x33/0x40 [ 1844.974493] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1844.979044] [] ? ktime_get_ts64+0x4c/0xf0 [ 1844.981679] [] ? bit_wait+0x50/0x50 [ 1844.985822] [] io_schedule_timeout+0xad/0x130 [ 1844.989491] [] io_schedule+0x18/0x20 [ 1844.991521] [] bit_wait_io+0x11/0x50 [ 1844.992817] [] __wait_on_bit+0x65/0x90 [ 1844.996383] [] ? bit_wait+0x50/0x50 [ 1844.998389] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1845.004028] [] ? wake_bit_function+0x40/0x40 [ 1845.006166] [] __wait_on_buffer+0x2a/0x30 [ 1845.009424] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1845.013982] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1845.016629] [] v2_read_header+0x1f/0x50 [ 1845.023226] [] v2_check_quota_file+0x2b/0x70 [ 1845.025650] [] ? igrab+0x36/0x60 [ 1845.030113] [] vfs_load_quota_inode+0x279/0x570 [ 1845.031937] [] ? unlock_new_inode+0x55/0x80 [ 1845.033528] [] dquot_enable+0xf0/0x110 [ 1845.035141] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1845.037217] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1845.039122] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1845.041533] [] mount_bdev+0x1b0/0x1f0 [ 1845.043396] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1845.048634] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1845.052977] [] mount_fs+0x39/0x1b0 [ 1845.058035] [] vfs_kern_mount+0x67/0x110 [ 1845.061996] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1845.068994] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1845.078058] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1845.087671] [] obd_setup+0x167/0x540 [obdclass] [ 1845.092454] [] class_setup+0x54f/0x830 [obdclass] [ 1845.095422] [] class_process_config+0x149b/0x2660 [obdclass] [ 1845.099952] [] ? __kmalloc+0x1e0/0x340 [ 1845.102746] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1845.107895] [] do_lcfg+0x263/0x520 [obdclass] [ 1845.109663] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1845.112138] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1845.113942] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1845.121312] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1845.127593] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1845.131966] [] mount_nodev+0x4d/0xb0 [ 1845.135606] [] lustre_mount+0x18/0x20 [lustre] [ 1845.138920] [] mount_fs+0x39/0x1b0 [ 1845.141653] [] vfs_kern_mount+0x67/0x110 [ 1845.148945] [] do_mount+0x1ef/0xce0 [ 1845.157113] [] ? copy_mount_options+0x39/0x1b0 [ 1845.159161] [] SyS_mount+0x83/0xd0 [ 1845.160934] [] system_call_fastpath+0x1f/0x24 [ 1845.164666] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1845.166977] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1845.233113] CPU: 1 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1845.243429] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1845.261617] Call Trace: [ 1845.262508] [] dump_stack+0x19/0x1b [ 1845.272309] [] __schedule_bug+0x64/0x72 [ 1845.280003] [] __schedule+0x791/0x7d0 [ 1845.289208] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1845.291782] [] ? bit_wait+0x50/0x50 [ 1845.316205] [] schedule+0x29/0x70 [ 1845.318251] [] schedule_timeout+0x209/0x290 [ 1845.319699] [] ? kvm_clock_read+0x33/0x40 [ 1845.322962] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1845.325573] [] ? ktime_get_ts64+0x4c/0xf0 [ 1845.328841] [] ? bit_wait+0x50/0x50 [ 1845.332666] [] io_schedule_timeout+0xad/0x130 [ 1845.336437] [] io_schedule+0x18/0x20 [ 1845.340734] [] bit_wait_io+0x11/0x50 [ 1845.345061] [] __wait_on_bit+0x65/0x90 [ 1845.376387] [] ? bit_wait+0x50/0x50 [ 1845.386033] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1845.396075] [] ? wake_bit_function+0x40/0x40 [ 1845.406827] [] __wait_on_buffer+0x2a/0x30 [ 1845.409086] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1845.413761] [] ? mark_page_accessed+0xd8/0xe0 [ 1845.417865] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1845.429259] [] v2_read_header+0x1f/0x50 [ 1845.436936] [] v2_check_quota_file+0x2b/0x70 [ 1845.445924] [] ? igrab+0x36/0x60 [ 1845.450946] [] vfs_load_quota_inode+0x279/0x570 [ 1845.453146] [] ? unlock_new_inode+0x55/0x80 [ 1845.455013] [] dquot_enable+0xf0/0x110 [ 1845.457020] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1845.458842] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1845.460789] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1845.462500] [] mount_bdev+0x1b0/0x1f0 [ 1845.463785] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1845.466209] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1845.467778] [] mount_fs+0x39/0x1b0 [ 1845.481265] [] vfs_kern_mount+0x67/0x110 [ 1845.495049] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1845.498524] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1845.509626] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1845.516217] [] obd_setup+0x167/0x540 [obdclass] [ 1845.526206] [] class_setup+0x54f/0x830 [obdclass] [ 1845.531011] [] class_process_config+0x149b/0x2660 [obdclass] [ 1845.533453] [] ? __kmalloc+0x1e0/0x340 [ 1845.535584] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1845.537915] [] do_lcfg+0x263/0x520 [obdclass] [ 1845.540086] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1845.575807] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1845.589244] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1845.600850] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1845.605973] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1845.613158] [] mount_nodev+0x4d/0xb0 [ 1845.621572] [] lustre_mount+0x18/0x20 [lustre] [ 1845.629446] [] mount_fs+0x39/0x1b0 [ 1845.636025] [] vfs_kern_mount+0x67/0x110 [ 1845.645508] [] do_mount+0x1ef/0xce0 [ 1845.653118] [] ? copy_mount_options+0x39/0x1b0 [ 1845.661645] [] SyS_mount+0x83/0xd0 [ 1845.671936] [] system_call_fastpath+0x1f/0x24 [ 1845.674325] BUG: sleeping function called from invalid context at kernel/mutex.c:104 [ 1845.677068] in_atomic(): 1, irqs_disabled(): 0, pid: 6093, name: mount.lustre [ 1845.682061] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1845.694494] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1845.705708] Call Trace: [ 1845.710077] [] dump_stack+0x19/0x1b [ 1845.711978] [] __might_sleep+0xd9/0x100 [ 1845.723008] [] mutex_lock+0x20/0x40 [ 1845.736190] [] vfs_load_quota_inode+0x2d8/0x570 [ 1845.739543] [] dquot_enable+0xf0/0x110 [ 1845.749578] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1845.762689] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1845.772724] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1845.776663] [] mount_bdev+0x1b0/0x1f0 [ 1845.790703] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1845.798421] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1845.807069] [] mount_fs+0x39/0x1b0 [ 1845.813926] [] vfs_kern_mount+0x67/0x110 [ 1845.822756] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1845.832087] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1845.836423] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1845.840669] [] obd_setup+0x167/0x540 [obdclass] [ 1845.843200] [] class_setup+0x54f/0x830 [obdclass] [ 1845.850380] [] class_process_config+0x149b/0x2660 [obdclass] [ 1845.861374] [] ? __kmalloc+0x1e0/0x340 [ 1845.867834] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1845.877076] [] do_lcfg+0x263/0x520 [obdclass] [ 1845.882893] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1845.893563] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1845.904706] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1845.911395] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1845.919481] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1845.927927] [] mount_nodev+0x4d/0xb0 [ 1845.933653] [] lustre_mount+0x18/0x20 [lustre] [ 1845.935885] [] mount_fs+0x39/0x1b0 [ 1845.937660] [] vfs_kern_mount+0x67/0x110 [ 1845.955902] [] do_mount+0x1ef/0xce0 [ 1845.957561] [] ? copy_mount_options+0x39/0x1b0 [ 1845.960180] [] SyS_mount+0x83/0xd0 [ 1845.966169] [] system_call_fastpath+0x1f/0x24 [ 1845.970527] BUG: scheduling while atomic: mount.lustre/6093/0x10000002 [ 1845.976125] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1846.035045] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1846.043746] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1846.067393] Call Trace: [ 1846.072879] [] dump_stack+0x19/0x1b [ 1846.077475] [] __schedule_bug+0x64/0x72 [ 1846.091112] [] __schedule+0x791/0x7d0 [ 1846.099996] [] __cond_resched+0x26/0x30 [ 1846.103199] [] _cond_resched+0x3a/0x50 [ 1846.111113] [] mutex_lock+0x25/0x40 [ 1846.115293] [] vfs_load_quota_inode+0x2d8/0x570 [ 1846.117355] [] dquot_enable+0xf0/0x110 [ 1846.120131] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 1846.123863] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 1846.126549] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 1846.129350] [] mount_bdev+0x1b0/0x1f0 [ 1846.131834] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 1846.135275] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 1846.137977] [] mount_fs+0x39/0x1b0 [ 1846.140020] [] vfs_kern_mount+0x67/0x110 [ 1846.143491] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 1846.146338] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1846.149965] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1846.154373] [] obd_setup+0x167/0x540 [obdclass] [ 1846.159580] [] class_setup+0x54f/0x830 [obdclass] [ 1846.165995] [] class_process_config+0x149b/0x2660 [obdclass] [ 1846.169010] [] ? __kmalloc+0x1e0/0x340 [ 1846.170754] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1846.173243] [] do_lcfg+0x263/0x520 [obdclass] [ 1846.178190] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1846.180797] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1846.184815] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1846.188060] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1846.193423] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1846.197483] [] mount_nodev+0x4d/0xb0 [ 1846.201074] [] lustre_mount+0x18/0x20 [lustre] [ 1846.203504] [] mount_fs+0x39/0x1b0 [ 1846.207470] [] vfs_kern_mount+0x67/0x110 [ 1846.210259] [] do_mount+0x1ef/0xce0 [ 1846.211988] [] ? copy_mount_options+0x39/0x1b0 [ 1846.216125] [] SyS_mount+0x83/0xd0 [ 1846.217656] [] system_call_fastpath+0x1f/0x24 [ 1846.220110] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1846.224885] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1846.228642] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1846.256394] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1846.261055] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1846.265675] Call Trace: [ 1846.268592] [] dump_stack+0x19/0x1b [ 1846.270549] [] __schedule_bug+0x64/0x72 [ 1846.272607] [] __schedule+0x791/0x7d0 [ 1846.274355] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1846.279193] [] ? bit_wait+0x50/0x50 [ 1846.284692] [] schedule+0x29/0x70 [ 1846.293232] [] schedule_timeout+0x209/0x290 [ 1846.295552] [] ? kvm_clock_read+0x33/0x40 [ 1846.297453] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1846.299783] [] ? ktime_get_ts64+0x4c/0xf0 [ 1846.301277] [] ? bit_wait+0x50/0x50 [ 1846.303028] [] io_schedule_timeout+0xad/0x130 [ 1846.309145] [] io_schedule+0x18/0x20 [ 1846.312052] [] bit_wait_io+0x11/0x50 [ 1846.315733] [] __wait_on_bit+0x65/0x90 [ 1846.318100] [] ? bit_wait+0x50/0x50 [ 1846.320021] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1846.327131] [] ? wake_bit_function+0x40/0x40 [ 1846.335427] [] __wait_on_buffer+0x2a/0x30 [ 1846.354577] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1846.356595] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1846.359116] [] read_blk+0x4c/0x60 [ 1846.360438] [] find_tree_dqentry+0x47/0x240 [ 1846.366320] [] find_tree_dqentry+0x1aa/0x240 [ 1846.370727] [] find_tree_dqentry+0x1aa/0x240 [ 1846.374391] [] find_tree_dqentry+0x1aa/0x240 [ 1846.388210] [] qtree_read_dquot+0x14c/0x380 [ 1846.391719] [] v2_read_dquot+0x2b/0x30 [ 1846.395446] [] dquot_acquire+0xe4/0x130 [ 1846.399144] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1846.405068] [] dqget+0x3fb/0x460 [ 1846.407176] [] __dquot_initialize+0x12d/0x230 [ 1846.411982] [] ? free_pages.part.76+0x40/0x50 [ 1846.414207] [] dquot_initialize+0x13/0x20 [ 1846.416318] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1846.418639] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1846.420716] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1846.441112] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1846.450474] [] obd_setup+0x167/0x540 [obdclass] [ 1846.455998] [] class_setup+0x54f/0x830 [obdclass] [ 1846.464001] [] class_process_config+0x149b/0x2660 [obdclass] [ 1846.467234] [] ? __kmalloc+0x1e0/0x340 [ 1846.468845] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1846.472020] [] do_lcfg+0x263/0x520 [obdclass] [ 1846.475681] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1846.481417] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1846.485342] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1846.488055] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1846.491715] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1846.494803] [] mount_nodev+0x4d/0xb0 [ 1846.500403] [] lustre_mount+0x18/0x20 [lustre] [ 1846.503189] [] mount_fs+0x39/0x1b0 [ 1846.504572] [] vfs_kern_mount+0x67/0x110 [ 1846.510298] [] do_mount+0x1ef/0xce0 [ 1846.513145] [] ? copy_mount_options+0x39/0x1b0 [ 1846.515767] [] SyS_mount+0x83/0xd0 [ 1846.519136] [] system_call_fastpath+0x1f/0x24 [ 1846.522984] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1846.528031] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1846.565590] CPU: 1 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1846.578139] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1846.595101] Call Trace: [ 1846.600849] [] dump_stack+0x19/0x1b [ 1846.608502] [] __schedule_bug+0x64/0x72 [ 1846.612414] [] __schedule+0x791/0x7d0 [ 1846.614581] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1846.619098] [] ? bit_wait+0x50/0x50 [ 1846.625158] [] schedule+0x29/0x70 [ 1846.627533] [] schedule_timeout+0x209/0x290 [ 1846.631788] [] ? kvm_clock_read+0x33/0x40 [ 1846.640907] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1846.648324] [] ? ktime_get_ts64+0x4c/0xf0 [ 1846.651762] [] ? bit_wait+0x50/0x50 [ 1846.653828] [] io_schedule_timeout+0xad/0x130 [ 1846.657035] [] io_schedule+0x18/0x20 [ 1846.660733] [] bit_wait_io+0x11/0x50 [ 1846.666890] [] __wait_on_bit+0x65/0x90 [ 1846.675228] [] ? bit_wait+0x50/0x50 [ 1846.676983] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1846.681421] [] ? wake_bit_function+0x40/0x40 [ 1846.688271] [] __wait_on_buffer+0x2a/0x30 [ 1846.692134] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1846.694520] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1846.699448] [] read_blk+0x4c/0x60 [ 1846.702040] [] find_tree_dqentry+0x47/0x240 [ 1846.704674] [] find_tree_dqentry+0x1aa/0x240 [ 1846.707212] [] find_tree_dqentry+0x1aa/0x240 [ 1846.711084] [] find_tree_dqentry+0x1aa/0x240 [ 1846.714823] [] qtree_read_dquot+0x14c/0x380 [ 1846.717200] [] v2_read_dquot+0x2b/0x30 [ 1846.721527] [] dquot_acquire+0xe4/0x130 [ 1846.723614] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1846.726858] [] dqget+0x3fb/0x460 [ 1846.729437] [] __dquot_initialize+0x12d/0x230 [ 1846.735814] [] dquot_initialize+0x13/0x20 [ 1846.741238] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1846.749293] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1846.751710] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1846.754278] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1846.756517] [] obd_setup+0x167/0x540 [obdclass] [ 1846.780399] [] class_setup+0x54f/0x830 [obdclass] [ 1846.782491] [] class_process_config+0x149b/0x2660 [obdclass] [ 1846.784963] [] ? __kmalloc+0x1e0/0x340 [ 1846.786403] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1846.788409] [] do_lcfg+0x263/0x520 [obdclass] [ 1846.790517] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1846.795262] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1846.799133] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1846.802941] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1846.808127] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1846.813585] [] mount_nodev+0x4d/0xb0 [ 1846.816094] [] lustre_mount+0x18/0x20 [lustre] [ 1846.824690] [] mount_fs+0x39/0x1b0 [ 1846.827159] [] vfs_kern_mount+0x67/0x110 [ 1846.829009] [] do_mount+0x1ef/0xce0 [ 1846.830622] [] ? copy_mount_options+0x39/0x1b0 [ 1846.832717] [] SyS_mount+0x83/0xd0 [ 1846.834127] [] system_call_fastpath+0x1f/0x24 [ 1846.839043] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 1846.844395] in_atomic(): 1, irqs_disabled(): 0, pid: 6093, name: mount.lustre [ 1846.847038] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1846.859165] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1846.866432] Call Trace: [ 1846.870243] [] dump_stack+0x19/0x1b [ 1846.874000] [] __might_sleep+0xd9/0x100 [ 1846.877986] [] __kmalloc+0x73/0x340 [ 1846.879603] [] ? getdqbuf+0x14/0x40 [ 1846.881502] [] getdqbuf+0x14/0x40 [ 1846.885667] [] find_tree_dqentry+0xaf/0x240 [ 1846.893531] [] find_tree_dqentry+0x1aa/0x240 [ 1846.896458] [] find_tree_dqentry+0x1aa/0x240 [ 1846.899362] [] find_tree_dqentry+0x1aa/0x240 [ 1846.901572] [] qtree_read_dquot+0x14c/0x380 [ 1846.903659] [] v2_read_dquot+0x2b/0x30 [ 1846.908397] [] dquot_acquire+0xe4/0x130 [ 1846.910593] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1846.913344] [] dqget+0x3fb/0x460 [ 1846.915337] [] __dquot_initialize+0x12d/0x230 [ 1846.917523] [] dquot_initialize+0x13/0x20 [ 1846.919666] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1846.923206] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1846.926954] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1846.931560] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1846.935101] [] obd_setup+0x167/0x540 [obdclass] [ 1846.937680] [] class_setup+0x54f/0x830 [obdclass] [ 1846.941851] [] class_process_config+0x149b/0x2660 [obdclass] [ 1846.945854] [] ? __kmalloc+0x1e0/0x340 [ 1846.949812] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1846.953625] [] do_lcfg+0x263/0x520 [obdclass] [ 1846.957938] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1846.962723] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1846.968639] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1846.975419] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1846.978554] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1846.981805] [] mount_nodev+0x4d/0xb0 [ 1846.987371] [] lustre_mount+0x18/0x20 [lustre] [ 1846.993997] [] mount_fs+0x39/0x1b0 [ 1846.999289] [] vfs_kern_mount+0x67/0x110 [ 1847.003724] [] do_mount+0x1ef/0xce0 [ 1847.006209] [] ? copy_mount_options+0x39/0x1b0 [ 1847.008507] [] SyS_mount+0x83/0xd0 [ 1847.010051] [] system_call_fastpath+0x1f/0x24 [ 1847.017495] BUG: scheduling while atomic: mount.lustre/6093/0x10000002 [ 1847.024293] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1847.076024] CPU: 0 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1847.081837] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1847.086653] Call Trace: [ 1847.088434] [] dump_stack+0x19/0x1b [ 1847.090383] [] __schedule_bug+0x64/0x72 [ 1847.094893] [] __schedule+0x791/0x7d0 [ 1847.098169] [] __cond_resched+0x26/0x30 [ 1847.103516] [] _cond_resched+0x3a/0x50 [ 1847.109027] [] __kmalloc+0x78/0x340 [ 1847.111726] [] ? getdqbuf+0x14/0x40 [ 1847.114145] [] getdqbuf+0x14/0x40 [ 1847.116020] [] find_tree_dqentry+0xaf/0x240 [ 1847.122430] [] find_tree_dqentry+0x1aa/0x240 [ 1847.126617] [] find_tree_dqentry+0x1aa/0x240 [ 1847.129422] [] find_tree_dqentry+0x1aa/0x240 [ 1847.134543] [] qtree_read_dquot+0x14c/0x380 [ 1847.141298] [] v2_read_dquot+0x2b/0x30 [ 1847.144392] [] dquot_acquire+0xe4/0x130 [ 1847.147845] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1847.150144] [] dqget+0x3fb/0x460 [ 1847.152495] [] __dquot_initialize+0x12d/0x230 [ 1847.154757] [] dquot_initialize+0x13/0x20 [ 1847.157025] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1847.159700] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1847.162849] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1847.165874] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1847.168105] [] obd_setup+0x167/0x540 [obdclass] [ 1847.170199] [] class_setup+0x54f/0x830 [obdclass] [ 1847.173393] [] class_process_config+0x149b/0x2660 [obdclass] [ 1847.177182] [] ? __kmalloc+0x1e0/0x340 [ 1847.183816] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1847.187636] [] do_lcfg+0x263/0x520 [obdclass] [ 1847.190238] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1847.193238] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1847.197114] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1847.200669] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1847.204103] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1847.210893] [] mount_nodev+0x4d/0xb0 [ 1847.214315] [] lustre_mount+0x18/0x20 [lustre] [ 1847.218050] [] mount_fs+0x39/0x1b0 [ 1847.221518] [] vfs_kern_mount+0x67/0x110 [ 1847.224420] [] do_mount+0x1ef/0xce0 [ 1847.228444] [] ? copy_mount_options+0x39/0x1b0 [ 1847.235695] [] SyS_mount+0x83/0xd0 [ 1847.238246] [] system_call_fastpath+0x1f/0x24 [ 1847.242431] BUG: scheduling while atomic: mount.lustre/6093/0x00000002 [ 1847.244535] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 1847.292611] CPU: 1 PID: 6093 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 1847.295772] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 1847.301675] Call Trace: [ 1847.302722] [] dump_stack+0x19/0x1b [ 1847.304305] [] __schedule_bug+0x64/0x72 [ 1847.308354] [] __schedule+0x791/0x7d0 [ 1847.315178] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 1847.321945] [] ? bit_wait+0x50/0x50 [ 1847.326524] [] schedule+0x29/0x70 [ 1847.328985] [] schedule_timeout+0x209/0x290 [ 1847.332562] [] ? kvm_clock_read+0x33/0x40 [ 1847.336613] [] ? kvm_clock_get_cycles+0x9/0x10 [ 1847.339810] [] ? ktime_get_ts64+0x4c/0xf0 [ 1847.343857] [] ? bit_wait+0x50/0x50 [ 1847.345676] [] io_schedule_timeout+0xad/0x130 [ 1847.347737] [] io_schedule+0x18/0x20 [ 1847.349357] [] bit_wait_io+0x11/0x50 [ 1847.353629] [] __wait_on_bit+0x65/0x90 [ 1847.358919] [] ? bit_wait+0x50/0x50 [ 1847.361436] [] out_of_line_wait_on_bit+0x81/0xb0 [ 1847.367594] [] ? wake_bit_function+0x40/0x40 [ 1847.370819] [] __wait_on_buffer+0x2a/0x30 [ 1847.372695] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 1847.374991] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 1847.377579] [] read_blk+0x4c/0x60 [ 1847.379394] [] find_tree_dqentry+0x47/0x240 [ 1847.381407] [] find_tree_dqentry+0x1aa/0x240 [ 1847.387442] [] find_tree_dqentry+0x1aa/0x240 [ 1847.400078] [] find_tree_dqentry+0x1aa/0x240 [ 1847.405050] [] qtree_read_dquot+0x14c/0x380 [ 1847.407419] [] v2_read_dquot+0x2b/0x30 [ 1847.412328] [] dquot_acquire+0xe4/0x130 [ 1847.416216] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 1847.419421] [] dqget+0x3fb/0x460 [ 1847.420909] [] __dquot_initialize+0x12d/0x230 [ 1847.424877] [] dquot_initialize+0x13/0x20 [ 1847.427707] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 1847.431468] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 1847.434523] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 1847.437965] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 1847.440899] [] obd_setup+0x167/0x540 [obdclass] [ 1847.444073] [] class_setup+0x54f/0x830 [obdclass] [ 1847.447533] [] class_process_config+0x149b/0x2660 [obdclass] [ 1847.452471] [] ? __kmalloc+0x1e0/0x340 [ 1847.456550] [] ? do_lcfg+0x168/0x520 [obdclass] [ 1847.459002] [] do_lcfg+0x263/0x520 [obdclass] [ 1847.461603] [] lustre_start_simple+0x88/0x210 [obdclass] [ 1847.464399] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 1847.468385] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 1847.471962] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 1847.474617] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 1847.478024] [] mount_nodev+0x4d/0xb0 [ 1847.480833] [] lustre_mount+0x18/0x20 [lustre] [ 1847.483778] [] mount_fs+0x39/0x1b0 [ 1847.488449] [] vfs_kern_mount+0x67/0x110 [ 1847.490202] [] do_mount+0x1ef/0xce0 [ 1847.491979] [] ? copy_mount_options+0x39/0x1b0 [ 1847.493897] [] SyS_mount+0x83/0xd0 [ 1847.498258] [] system_call_fastpath+0x1f/0x24 [ 1847.601223] LustreError: MGC192.168.204.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1847.782715] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1847.815458] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1849.135625] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 1849.703344] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1852.775863] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to (at 0@lo) [ 1852.785074] Lustre: Skipped 1 previous similar message [ 1852.789140] LustreError: 3768:0:(ldlm_resource.c:981:ldlm_resource_complain()) lustre-MDT0000-lwp-OST0001: namespace resource [0x200000006:0x2020000:0x0].0x0 (ffff8801318d6600) refcount nonzero (1) after lock cleanup; forcing cleanup. [ 1852.857808] Lustre: lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [ 1852.895331] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:128 to 0x280000401:161) [ 1852.895416] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:128 to 0x2c0000401:161) [ 1853.750256] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1950.348630] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1952.674380] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1955.426535] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1958.387620] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1961.345801] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 1978.869306] Lustre: DEBUG MARKER: == sanity-quota test 7d: Quota reintegration (Transfer index in multiple bulks) ========================================================== 07:46:13 (1750592773) [ 1988.365235] LustreError: 14361:0:(qsd_reint.c:620:qqi_reint_delayed()) lustre-MDT0001: Delaying reintegration for qtype:0 until pending updates are flushed. [ 1988.371107] LustreError: 14361:0:(qsd_reint.c:620:qqi_reint_delayed()) Skipped 17 previous similar messages [ 1992.079648] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 [ 1994.516806] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 [ 2019.784667] Lustre: DEBUG MARKER: == sanity-quota test 7e: Quota reintegration (inode limits) ========================================================== 07:46:54 (1750592814) [ 2036.041402] Lustre: Failing over lustre-MDT0001 [ 2036.141577] LustreError: 17469:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 2036.148539] LustreError: 17469:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2036.189510] Lustre: server umount lustre-MDT0001 complete [ 2038.083345] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2038.086863] LustreError: 10181:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2038.086866] LustreError: 10181:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 11 previous similar messages [ 2038.099513] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 2038.099515] LustreError: Skipped 2 previous similar messages [ 2038.122678] Lustre: Skipped 5 previous similar messages [ 2039.757443] LustreError: 17827:0:(qsd_reint.c:620:qqi_reint_delayed()) lustre-OST0001: Delaying reintegration for qtype:0 until pending updates are flushed. [ 2039.763201] LustreError: 17827:0:(qsd_reint.c:620:qqi_reint_delayed()) Skipped 5 previous similar messages [ 2045.933506] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2045.936268] in_atomic(): 1, irqs_disabled(): 0, pid: 18400, name: mount.lustre [ 2045.941330] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2045.954009] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2045.964518] Call Trace: [ 2045.965624] [] dump_stack+0x19/0x1b [ 2045.967241] [] __might_sleep+0xd9/0x100 [ 2045.976808] [] kmem_cache_alloc+0x4f/0x2e0 [ 2045.980811] [] alloc_vfsmnt+0x24/0x240 [ 2045.984183] [] vfs_kern_mount+0x36/0x110 [ 2045.989225] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2045.996949] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2045.999634] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2046.002041] [] obd_setup+0x167/0x540 [obdclass] [ 2046.015819] [] class_setup+0x54f/0x830 [obdclass] [ 2046.031718] [] class_process_config+0x149b/0x2660 [obdclass] [ 2046.041304] [] ? __kmalloc+0x1e0/0x340 [ 2046.051360] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2046.057405] [] do_lcfg+0x263/0x520 [obdclass] [ 2046.068947] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2046.082037] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2046.091603] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2046.101286] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2046.116153] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2046.124301] [] mount_nodev+0x4d/0xb0 [ 2046.132418] [] lustre_mount+0x18/0x20 [lustre] [ 2046.141047] [] mount_fs+0x39/0x1b0 [ 2046.147798] [] vfs_kern_mount+0x67/0x110 [ 2046.150526] [] do_mount+0x1ef/0xce0 [ 2046.152822] [] ? copy_mount_options+0x39/0x1b0 [ 2046.155832] [] SyS_mount+0x83/0xd0 [ 2046.157757] [] system_call_fastpath+0x1f/0x24 [ 2046.166176] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2046.169423] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2046.209144] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2046.214244] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2046.220904] Call Trace: [ 2046.223695] [] dump_stack+0x19/0x1b [ 2046.228064] [] __schedule_bug+0x64/0x72 [ 2046.231471] [] __schedule+0x791/0x7d0 [ 2046.234604] [] ? alloc_vfsmnt+0x24/0x240 [ 2046.237497] [] __cond_resched+0x26/0x30 [ 2046.240712] [] _cond_resched+0x3a/0x50 [ 2046.245242] [] kmem_cache_alloc+0x54/0x2e0 [ 2046.247554] [] alloc_vfsmnt+0x24/0x240 [ 2046.251981] [] vfs_kern_mount+0x36/0x110 [ 2046.255588] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2046.261238] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2046.266056] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2046.268671] [] obd_setup+0x167/0x540 [obdclass] [ 2046.271092] [] class_setup+0x54f/0x830 [obdclass] [ 2046.273527] [] class_process_config+0x149b/0x2660 [obdclass] [ 2046.275979] [] ? __kmalloc+0x1e0/0x340 [ 2046.290179] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2046.293385] [] do_lcfg+0x263/0x520 [obdclass] [ 2046.298537] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2046.307145] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2046.334778] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2046.337949] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2046.358734] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2046.369868] [] mount_nodev+0x4d/0xb0 [ 2046.376269] [] lustre_mount+0x18/0x20 [lustre] [ 2046.390019] [] mount_fs+0x39/0x1b0 [ 2046.392073] [] vfs_kern_mount+0x67/0x110 [ 2046.394184] [] do_mount+0x1ef/0xce0 [ 2046.396025] [] ? copy_mount_options+0x39/0x1b0 [ 2046.398267] [] SyS_mount+0x83/0xd0 [ 2046.400225] [] system_call_fastpath+0x1f/0x24 [ 2046.448337] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2046.467376] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2046.512513] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2046.516525] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2046.519386] Call Trace: [ 2046.520356] [] dump_stack+0x19/0x1b [ 2046.567368] [] __schedule_bug+0x64/0x72 [ 2046.585342] [] __schedule+0x791/0x7d0 [ 2046.590551] [] __cond_resched+0x26/0x30 [ 2046.599625] [] _cond_resched+0x3a/0x50 [ 2046.611918] [] truncate_inode_pages_range+0x237/0x7d0 [ 2046.615927] [] truncate_inode_pages+0x15/0x20 [ 2046.619933] [] kill_bdev+0x35/0x40 [ 2046.624275] [] set_blocksize+0xab/0xd0 [ 2046.626840] [] sb_set_blocksize+0x1d/0x50 [ 2046.628642] [] sb_min_blocksize+0x42/0x60 [ 2046.631563] [] ldiskfs_fill_super+0x1c2/0x3060 [ldiskfs] [ 2046.635153] [] ? snprintf+0x49/0x70 [ 2046.637966] [] mount_bdev+0x1b0/0x1f0 [ 2046.641414] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2046.645451] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2046.649637] [] mount_fs+0x39/0x1b0 [ 2046.652857] [] vfs_kern_mount+0x67/0x110 [ 2046.655969] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2046.658703] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2046.662152] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2046.667145] [] obd_setup+0x167/0x540 [obdclass] [ 2046.685202] [] class_setup+0x54f/0x830 [obdclass] [ 2046.689829] [] class_process_config+0x149b/0x2660 [obdclass] [ 2046.699421] [] ? __kmalloc+0x1e0/0x340 [ 2046.701824] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2046.706108] [] do_lcfg+0x263/0x520 [obdclass] [ 2046.708960] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2046.716775] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2046.727780] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2046.739748] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2046.756156] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2046.763370] [] mount_nodev+0x4d/0xb0 [ 2046.768405] [] lustre_mount+0x18/0x20 [lustre] [ 2046.775666] [] mount_fs+0x39/0x1b0 [ 2046.787088] [] vfs_kern_mount+0x67/0x110 [ 2046.793944] [] do_mount+0x1ef/0xce0 [ 2046.806140] [] ? copy_mount_options+0x39/0x1b0 [ 2046.808687] [] SyS_mount+0x83/0xd0 [ 2046.810579] [] system_call_fastpath+0x1f/0x24 [ 2046.813139] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2046.815524] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2046.905144] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2046.913914] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2046.922471] Call Trace: [ 2046.925718] [] dump_stack+0x19/0x1b [ 2046.929483] [] __schedule_bug+0x64/0x72 [ 2046.937205] [] __schedule+0x791/0x7d0 [ 2046.942984] [] ? bit_wait+0x50/0x50 [ 2046.948879] [] schedule+0x29/0x70 [ 2046.952856] [] schedule_timeout+0x209/0x290 [ 2046.958466] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 2046.972929] [] ? kvm_clock_read+0x33/0x40 [ 2046.984583] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2046.994286] [] ? ktime_get_ts64+0x4c/0xf0 [ 2047.005375] [] ? bit_wait+0x50/0x50 [ 2047.013555] [] io_schedule_timeout+0xad/0x130 [ 2047.015393] [] io_schedule+0x18/0x20 [ 2047.017026] [] bit_wait_io+0x11/0x50 [ 2047.032902] [] __wait_on_bit+0x65/0x90 [ 2047.044283] [] ? bit_wait+0x50/0x50 [ 2047.062916] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2047.064928] [] ? wake_bit_function+0x40/0x40 [ 2047.066631] [] __bread+0xad/0xf0 [ 2047.068063] [] ldiskfs_fill_super+0x201/0x3060 [ldiskfs] [ 2047.070263] [] ? snprintf+0x49/0x70 [ 2047.071987] [] mount_bdev+0x1b0/0x1f0 [ 2047.097558] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2047.101018] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2047.105225] [] mount_fs+0x39/0x1b0 [ 2047.107361] [] vfs_kern_mount+0x67/0x110 [ 2047.113227] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2047.117062] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2047.121086] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2047.125874] [] obd_setup+0x167/0x540 [obdclass] [ 2047.136134] [] class_setup+0x54f/0x830 [obdclass] [ 2047.144156] [] class_process_config+0x149b/0x2660 [obdclass] [ 2047.153704] [] ? __kmalloc+0x1e0/0x340 [ 2047.159352] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2047.163997] [] do_lcfg+0x263/0x520 [obdclass] [ 2047.168631] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2047.171351] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2047.175843] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2047.180165] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2047.186966] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2047.195931] [] mount_nodev+0x4d/0xb0 [ 2047.197842] [] lustre_mount+0x18/0x20 [lustre] [ 2047.199987] [] mount_fs+0x39/0x1b0 [ 2047.209573] [] vfs_kern_mount+0x67/0x110 [ 2047.211259] [] do_mount+0x1ef/0xce0 [ 2047.212451] [] ? copy_mount_options+0x39/0x1b0 [ 2047.216622] [] SyS_mount+0x83/0xd0 [ 2047.218371] [] system_call_fastpath+0x1f/0x24 [ 2047.230345] BUG: sleeping function called from invalid context at mm/page-writeback.c:1810 [ 2047.242431] in_atomic(): 1, irqs_disabled(): 0, pid: 18400, name: mount.lustre [ 2047.249893] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2047.256778] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2047.261333] Call Trace: [ 2047.264450] [] dump_stack+0x19/0x1b [ 2047.267095] [] __might_sleep+0xd9/0x100 [ 2047.269012] [] tag_pages_for_writeback+0x7b/0xe0 [ 2047.271026] [] write_cache_pages+0x9f/0x4c0 [ 2047.279678] [] ? __schedule+0x32a/0x7d0 [ 2047.291046] [] ? global_dirtyable_memory+0x70/0x70 [ 2047.296555] [] ? kvm_clock_read+0x33/0x40 [ 2047.304876] [] ? do_raw_spin_unlock+0x49/0x90 [ 2047.309483] [] generic_writepages+0x50/0x80 [ 2047.314847] [] blkdev_writepages+0xe/0x10 [ 2047.317975] [] do_writepages+0x21/0x50 [ 2047.321503] [] __filemap_fdatawrite_range+0x65/0x80 [ 2047.327835] [] filemap_write_and_wait+0x40/0x90 [ 2047.335509] [] __sync_blockdev+0x1f/0x40 [ 2047.341301] [] set_blocksize+0x7b/0xd0 [ 2047.347494] [] sb_set_blocksize+0x1d/0x50 [ 2047.351545] [] ldiskfs_fill_super+0x8c3/0x3060 [ldiskfs] [ 2047.354131] [] mount_bdev+0x1b0/0x1f0 [ 2047.359553] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2047.365952] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2047.374456] [] mount_fs+0x39/0x1b0 [ 2047.377700] [] vfs_kern_mount+0x67/0x110 [ 2047.385628] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2047.388611] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2047.394529] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2047.397513] [] obd_setup+0x167/0x540 [obdclass] [ 2047.402573] [] class_setup+0x54f/0x830 [obdclass] [ 2047.406412] [] class_process_config+0x149b/0x2660 [obdclass] [ 2047.412023] [] ? __kmalloc+0x1e0/0x340 [ 2047.417778] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2047.423700] [] do_lcfg+0x263/0x520 [obdclass] [ 2047.426009] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2047.428504] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2047.430567] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2047.434874] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2047.436738] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2047.439184] [] mount_nodev+0x4d/0xb0 [ 2047.446410] [] lustre_mount+0x18/0x20 [lustre] [ 2047.449948] [] mount_fs+0x39/0x1b0 [ 2047.452497] [] vfs_kern_mount+0x67/0x110 [ 2047.456542] [] do_mount+0x1ef/0xce0 [ 2047.462639] [] ? copy_mount_options+0x39/0x1b0 [ 2047.471329] [] SyS_mount+0x83/0xd0 [ 2047.474999] [] system_call_fastpath+0x1f/0x24 [ 2047.477133] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2047.484472] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2047.535785] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2047.541192] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2047.545412] Call Trace: [ 2047.546515] [] dump_stack+0x19/0x1b [ 2047.549295] [] __schedule_bug+0x64/0x72 [ 2047.552213] [] __schedule+0x791/0x7d0 [ 2047.554476] [] __cond_resched+0x26/0x30 [ 2047.559414] [] _cond_resched+0x3a/0x50 [ 2047.561999] [] tag_pages_for_writeback+0x80/0xe0 [ 2047.564826] [] write_cache_pages+0x9f/0x4c0 [ 2047.568662] [] ? __schedule+0x32a/0x7d0 [ 2047.576375] [] ? global_dirtyable_memory+0x70/0x70 [ 2047.585929] [] ? kvm_clock_read+0x33/0x40 [ 2047.594571] [] ? do_raw_spin_unlock+0x49/0x90 [ 2047.602646] [] generic_writepages+0x50/0x80 [ 2047.612160] [] blkdev_writepages+0xe/0x10 [ 2047.615636] [] do_writepages+0x21/0x50 [ 2047.623170] [] __filemap_fdatawrite_range+0x65/0x80 [ 2047.634858] [] filemap_write_and_wait+0x40/0x90 [ 2047.641512] [] __sync_blockdev+0x1f/0x40 [ 2047.650189] [] set_blocksize+0x7b/0xd0 [ 2047.656382] [] sb_set_blocksize+0x1d/0x50 [ 2047.659598] [] ldiskfs_fill_super+0x8c3/0x3060 [ldiskfs] [ 2047.666236] [] mount_bdev+0x1b0/0x1f0 [ 2047.674893] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2047.681417] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2047.687452] [] mount_fs+0x39/0x1b0 [ 2047.695039] [] vfs_kern_mount+0x67/0x110 [ 2047.706245] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2047.716057] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2047.722904] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2047.726654] [] obd_setup+0x167/0x540 [obdclass] [ 2047.741716] [] class_setup+0x54f/0x830 [obdclass] [ 2047.748383] [] class_process_config+0x149b/0x2660 [obdclass] [ 2047.755453] [] ? __kmalloc+0x1e0/0x340 [ 2047.760848] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2047.763324] [] do_lcfg+0x263/0x520 [obdclass] [ 2047.765567] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2047.768172] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2047.774869] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2047.779877] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2047.784045] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2047.788538] [] mount_nodev+0x4d/0xb0 [ 2047.792039] [] lustre_mount+0x18/0x20 [lustre] [ 2047.795177] [] mount_fs+0x39/0x1b0 [ 2047.800615] [] vfs_kern_mount+0x67/0x110 [ 2047.803134] [] do_mount+0x1ef/0xce0 [ 2047.806666] [] ? copy_mount_options+0x39/0x1b0 [ 2047.810848] [] SyS_mount+0x83/0xd0 [ 2047.813488] [] system_call_fastpath+0x1f/0x24 [ 2047.818675] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2047.821169] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2047.850570] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2047.854344] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2047.857070] Call Trace: [ 2047.858034] [] dump_stack+0x19/0x1b [ 2047.859839] [] __schedule_bug+0x64/0x72 [ 2047.861448] [] __schedule+0x791/0x7d0 [ 2047.863343] [] ? bit_wait+0x50/0x50 [ 2047.865189] [] schedule+0x29/0x70 [ 2047.867588] [] schedule_timeout+0x209/0x290 [ 2047.870364] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 2047.873364] [] ? kvm_clock_read+0x33/0x40 [ 2047.878233] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2047.882627] [] ? ktime_get_ts64+0x4c/0xf0 [ 2047.890297] [] ? bit_wait+0x50/0x50 [ 2047.896219] [] io_schedule_timeout+0xad/0x130 [ 2047.897882] [] io_schedule+0x18/0x20 [ 2047.913277] [] bit_wait_io+0x11/0x50 [ 2047.918625] [] __wait_on_bit+0x65/0x90 [ 2047.925899] [] ? bit_wait+0x50/0x50 [ 2047.927597] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2047.937107] [] ? wake_bit_function+0x40/0x40 [ 2047.947033] [] __bread+0xad/0xf0 [ 2047.953048] [] ldiskfs_fill_super+0x8ff/0x3060 [ldiskfs] [ 2047.961718] [] mount_bdev+0x1b0/0x1f0 [ 2047.972860] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2047.984963] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2047.996609] [] mount_fs+0x39/0x1b0 [ 2048.003420] [] vfs_kern_mount+0x67/0x110 [ 2048.010154] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2048.020417] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2048.030572] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2048.036118] [] obd_setup+0x167/0x540 [obdclass] [ 2048.038702] [] class_setup+0x54f/0x830 [obdclass] [ 2048.040841] [] class_process_config+0x149b/0x2660 [obdclass] [ 2048.045506] [] ? __kmalloc+0x1e0/0x340 [ 2048.049000] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2048.054858] [] do_lcfg+0x263/0x520 [obdclass] [ 2048.056755] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2048.059952] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2048.065230] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2048.067754] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2048.070060] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2048.072247] [] mount_nodev+0x4d/0xb0 [ 2048.073989] [] lustre_mount+0x18/0x20 [lustre] [ 2048.085176] [] mount_fs+0x39/0x1b0 [ 2048.091908] [] vfs_kern_mount+0x67/0x110 [ 2048.094708] [] do_mount+0x1ef/0xce0 [ 2048.099919] [] ? copy_mount_options+0x39/0x1b0 [ 2048.108817] [] SyS_mount+0x83/0xd0 [ 2048.116527] [] system_call_fastpath+0x1f/0x24 [ 2048.127702] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2048.133359] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2048.186891] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2048.203342] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2048.214665] Call Trace: [ 2048.217389] [] dump_stack+0x19/0x1b [ 2048.219867] [] __schedule_bug+0x64/0x72 [ 2048.224060] [] __schedule+0x791/0x7d0 [ 2048.227055] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2048.230690] [] ? bit_wait+0x50/0x50 [ 2048.234067] [] schedule+0x29/0x70 [ 2048.236936] [] schedule_timeout+0x209/0x290 [ 2048.239489] [] ? kvm_clock_read+0x33/0x40 [ 2048.245967] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2048.253650] [] ? ktime_get_ts64+0x4c/0xf0 [ 2048.256552] [] ? bit_wait+0x50/0x50 [ 2048.264510] [] io_schedule_timeout+0xad/0x130 [ 2048.271709] [] io_schedule+0x18/0x20 [ 2048.276064] [] bit_wait_io+0x11/0x50 [ 2048.282319] [] __wait_on_bit_lock+0x5f/0xc0 [ 2048.290852] [] ? bit_wait+0x50/0x50 [ 2048.295399] [] out_of_line_wait_on_bit_lock+0x81/0xb0 [ 2048.299332] [] ? wake_bit_function+0x40/0x40 [ 2048.302481] [] wait_on_bit_lock_io.constprop.40+0x2a/0x30 [ 2048.306278] [] __bread+0xe6/0xf0 [ 2048.312264] [] ldiskfs_fill_super+0x1675/0x3060 [ldiskfs] [ 2048.317493] [] mount_bdev+0x1b0/0x1f0 [ 2048.324960] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2048.333913] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2048.340528] [] mount_fs+0x39/0x1b0 [ 2048.344689] [] vfs_kern_mount+0x67/0x110 [ 2048.349643] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2048.352335] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2048.356896] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2048.360615] [] obd_setup+0x167/0x540 [obdclass] [ 2048.365279] [] class_setup+0x54f/0x830 [obdclass] [ 2048.370422] [] class_process_config+0x149b/0x2660 [obdclass] [ 2048.373162] [] ? __kmalloc+0x1e0/0x340 [ 2048.375247] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2048.377480] [] do_lcfg+0x263/0x520 [obdclass] [ 2048.383170] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2048.387694] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2048.401912] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2048.409724] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2048.416590] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2048.427634] [] mount_nodev+0x4d/0xb0 [ 2048.436117] [] lustre_mount+0x18/0x20 [lustre] [ 2048.445662] [] mount_fs+0x39/0x1b0 [ 2048.454293] [] vfs_kern_mount+0x67/0x110 [ 2048.459888] [] do_mount+0x1ef/0xce0 [ 2048.466640] [] ? copy_mount_options+0x39/0x1b0 [ 2048.474995] [] SyS_mount+0x83/0xd0 [ 2048.479736] [] system_call_fastpath+0x1f/0x24 [ 2048.488011] BUG: sleeping function called from invalid context at kernel/rwsem.c:51 [ 2048.497142] in_atomic(): 1, irqs_disabled(): 0, pid: 18400, name: mount.lustre [ 2048.500308] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2048.509682] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2048.523243] Call Trace: [ 2048.526536] [] dump_stack+0x19/0x1b [ 2048.529921] [] __might_sleep+0xd9/0x100 [ 2048.533728] [] down_write+0x20/0x50 [ 2048.535595] [] register_shrinker+0x21/0x50 [ 2048.539861] [] ldiskfs_es_register_shrinker+0x65/0x70 [ldiskfs] [ 2048.543362] [] ldiskfs_fill_super+0x1800/0x3060 [ldiskfs] [ 2048.546298] [] mount_bdev+0x1b0/0x1f0 [ 2048.550686] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2048.556061] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2048.558392] [] mount_fs+0x39/0x1b0 [ 2048.560181] [] vfs_kern_mount+0x67/0x110 [ 2048.562263] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2048.564685] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2048.579700] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2048.595772] [] obd_setup+0x167/0x540 [obdclass] [ 2048.603961] [] class_setup+0x54f/0x830 [obdclass] [ 2048.611587] [] class_process_config+0x149b/0x2660 [obdclass] [ 2048.618735] [] ? __kmalloc+0x1e0/0x340 [ 2048.622045] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2048.628129] [] do_lcfg+0x263/0x520 [obdclass] [ 2048.633699] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2048.639071] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2048.644029] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2048.648529] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2048.651811] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2048.654665] [] mount_nodev+0x4d/0xb0 [ 2048.657010] [] lustre_mount+0x18/0x20 [lustre] [ 2048.659594] [] mount_fs+0x39/0x1b0 [ 2048.661545] [] vfs_kern_mount+0x67/0x110 [ 2048.663821] [] do_mount+0x1ef/0xce0 [ 2048.666170] [] ? copy_mount_options+0x39/0x1b0 [ 2048.672794] [] SyS_mount+0x83/0xd0 [ 2048.683641] [] system_call_fastpath+0x1f/0x24 [ 2048.702752] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2048.712470] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2048.761825] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2048.773973] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2048.784267] Call Trace: [ 2048.788360] [] dump_stack+0x19/0x1b [ 2048.796719] [] __schedule_bug+0x64/0x72 [ 2048.803218] [] __schedule+0x791/0x7d0 [ 2048.805420] [] __cond_resched+0x26/0x30 [ 2048.812916] [] _cond_resched+0x3a/0x50 [ 2048.818406] [] down_write+0x25/0x50 [ 2048.821306] [] register_shrinker+0x21/0x50 [ 2048.823629] [] ldiskfs_es_register_shrinker+0x65/0x70 [ldiskfs] [ 2048.826038] [] ldiskfs_fill_super+0x1800/0x3060 [ldiskfs] [ 2048.829949] [] mount_bdev+0x1b0/0x1f0 [ 2048.831872] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2048.835245] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2048.837547] [] mount_fs+0x39/0x1b0 [ 2048.839627] [] vfs_kern_mount+0x67/0x110 [ 2048.841751] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2048.844116] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2048.846653] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2048.849139] [] obd_setup+0x167/0x540 [obdclass] [ 2048.861195] [] class_setup+0x54f/0x830 [obdclass] [ 2048.869762] [] class_process_config+0x149b/0x2660 [obdclass] [ 2048.876249] [] ? __kmalloc+0x1e0/0x340 [ 2048.878979] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2048.882998] [] do_lcfg+0x263/0x520 [obdclass] [ 2048.890167] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2048.898632] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2048.901678] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2048.906910] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2048.910734] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2048.919023] [] mount_nodev+0x4d/0xb0 [ 2048.920555] [] lustre_mount+0x18/0x20 [lustre] [ 2048.923490] [] mount_fs+0x39/0x1b0 [ 2048.926855] [] vfs_kern_mount+0x67/0x110 [ 2048.931045] [] do_mount+0x1ef/0xce0 [ 2048.933762] [] ? copy_mount_options+0x39/0x1b0 [ 2048.937898] [] SyS_mount+0x83/0xd0 [ 2048.947803] [] system_call_fastpath+0x1f/0x24 [ 2048.973066] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2048.978181] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2049.054591] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2049.059872] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2049.064274] Call Trace: [ 2049.065548] [] dump_stack+0x19/0x1b [ 2049.070966] [] __schedule_bug+0x64/0x72 [ 2049.078259] [] __schedule+0x791/0x7d0 [ 2049.079747] [] ? bit_wait+0x50/0x50 [ 2049.081257] [] schedule+0x29/0x70 [ 2049.083133] [] schedule_timeout+0x209/0x290 [ 2049.085510] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 2049.087828] [] ? kvm_clock_read+0x33/0x40 [ 2049.090570] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2049.098676] [] ? bit_wait+0x50/0x50 [ 2049.104060] [] io_schedule_timeout+0xad/0x130 [ 2049.111321] [] io_schedule+0x18/0x20 [ 2049.117060] [] bit_wait_io+0x11/0x50 [ 2049.123198] [] __wait_on_bit+0x65/0x90 [ 2049.125181] [] ? bit_wait+0x50/0x50 [ 2049.129856] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2049.135285] [] ? wake_bit_function+0x40/0x40 [ 2049.143891] [] __wait_on_buffer+0x2a/0x30 [ 2049.147943] [] __ldiskfs_get_inode_loc+0x1bd/0x400 [ldiskfs] [ 2049.154792] [] ldiskfs_iget+0x96/0xc60 [ldiskfs] [ 2049.161414] [] ldiskfs_load_journal+0x19e/0x71c [ldiskfs] [ 2049.165632] [] ? do_raw_spin_unlock+0x49/0x90 [ 2049.170988] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2049.175473] [] mount_bdev+0x1b0/0x1f0 [ 2049.179103] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2049.183056] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2049.185474] [] mount_fs+0x39/0x1b0 [ 2049.190093] [] vfs_kern_mount+0x67/0x110 [ 2049.193744] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2049.196449] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2049.199196] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2049.202985] [] obd_setup+0x167/0x540 [obdclass] [ 2049.207035] [] class_setup+0x54f/0x830 [obdclass] [ 2049.209572] [] class_process_config+0x149b/0x2660 [obdclass] [ 2049.214380] [] ? __kmalloc+0x1e0/0x340 [ 2049.221615] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2049.228193] [] do_lcfg+0x263/0x520 [obdclass] [ 2049.230377] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2049.234514] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2049.238651] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2049.243380] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2049.249093] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2049.254953] [] mount_nodev+0x4d/0xb0 [ 2049.260411] [] lustre_mount+0x18/0x20 [lustre] [ 2049.262675] [] mount_fs+0x39/0x1b0 [ 2049.264329] [] vfs_kern_mount+0x67/0x110 [ 2049.266167] [] do_mount+0x1ef/0xce0 [ 2049.268408] [] ? copy_mount_options+0x39/0x1b0 [ 2049.271314] [] SyS_mount+0x83/0xd0 [ 2049.276481] [] system_call_fastpath+0x1f/0x24 [ 2049.279329] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2049.283098] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2049.319488] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2049.330574] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2049.341079] Call Trace: [ 2049.341919] [] dump_stack+0x19/0x1b [ 2049.354048] [] __schedule_bug+0x64/0x72 [ 2049.359611] [] __schedule+0x791/0x7d0 [ 2049.363435] [] ? bit_wait+0x50/0x50 [ 2049.365764] [] schedule+0x29/0x70 [ 2049.368856] [] schedule_timeout+0x209/0x290 [ 2049.370923] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 2049.373503] [] ? kvm_clock_read+0x33/0x40 [ 2049.375695] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2049.381511] [] ? bit_wait+0x50/0x50 [ 2049.387009] [] io_schedule_timeout+0xad/0x130 [ 2049.392138] [] io_schedule+0x18/0x20 [ 2049.398101] [] bit_wait_io+0x11/0x50 [ 2049.400426] [] __wait_on_bit+0x65/0x90 [ 2049.405209] [] ? bit_wait+0x50/0x50 [ 2049.409302] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2049.412970] [] ? wake_bit_function+0x40/0x40 [ 2049.416704] [] __wait_on_buffer+0x2a/0x30 [ 2049.419622] [] journal_get_superblock+0x2c8/0x3a0 [jbd2] [ 2049.421922] [] jbd2_journal_wipe+0x20/0xb0 [jbd2] [ 2049.425441] [] ldiskfs_load_journal+0x5c5/0x71c [ldiskfs] [ 2049.429507] [] ? do_raw_spin_unlock+0x49/0x90 [ 2049.432107] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2049.434349] [] mount_bdev+0x1b0/0x1f0 [ 2049.438471] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2049.441578] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2049.445543] [] mount_fs+0x39/0x1b0 [ 2049.448325] [] vfs_kern_mount+0x67/0x110 [ 2049.450977] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2049.456317] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2049.458874] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2049.464151] [] obd_setup+0x167/0x540 [obdclass] [ 2049.466603] [] class_setup+0x54f/0x830 [obdclass] [ 2049.470160] [] class_process_config+0x149b/0x2660 [obdclass] [ 2049.473252] [] ? __kmalloc+0x1e0/0x340 [ 2049.475718] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2049.478704] [] do_lcfg+0x263/0x520 [obdclass] [ 2049.481394] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2049.486613] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2049.492460] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2049.495213] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2049.499145] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2049.502174] [] mount_nodev+0x4d/0xb0 [ 2049.504427] [] lustre_mount+0x18/0x20 [lustre] [ 2049.508306] [] mount_fs+0x39/0x1b0 [ 2049.509977] [] vfs_kern_mount+0x67/0x110 [ 2049.514818] [] do_mount+0x1ef/0xce0 [ 2049.519312] [] ? copy_mount_options+0x39/0x1b0 [ 2049.524108] [] SyS_mount+0x83/0xd0 [ 2049.526349] [] system_call_fastpath+0x1f/0x24 [ 2049.528508] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2049.531653] in_atomic(): 1, irqs_disabled(): 0, pid: 18400, name: mount.lustre [ 2049.534148] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2049.541539] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2049.545211] Call Trace: [ 2049.546758] [] dump_stack+0x19/0x1b [ 2049.548681] [] __might_sleep+0xd9/0x100 [ 2049.551796] [] kmem_cache_alloc_trace+0x57/0x2e0 [ 2049.557359] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 2049.563036] [] ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 2049.566261] [] ? do_raw_spin_unlock+0x49/0x90 [ 2049.572745] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2049.577967] [] mount_bdev+0x1b0/0x1f0 [ 2049.579829] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2049.585857] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2049.588790] [] mount_fs+0x39/0x1b0 [ 2049.592640] [] vfs_kern_mount+0x67/0x110 [ 2049.597530] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2049.602626] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2049.608772] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2049.612332] [] obd_setup+0x167/0x540 [obdclass] [ 2049.615226] [] class_setup+0x54f/0x830 [obdclass] [ 2049.617853] [] class_process_config+0x149b/0x2660 [obdclass] [ 2049.620591] [] ? __kmalloc+0x1e0/0x340 [ 2049.623939] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2049.626340] [] do_lcfg+0x263/0x520 [obdclass] [ 2049.628583] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2049.630960] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2049.637233] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2049.647993] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2049.652773] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2049.658013] [] mount_nodev+0x4d/0xb0 [ 2049.662060] [] lustre_mount+0x18/0x20 [lustre] [ 2049.671201] [] mount_fs+0x39/0x1b0 [ 2049.675372] [] vfs_kern_mount+0x67/0x110 [ 2049.684387] [] do_mount+0x1ef/0xce0 [ 2049.690242] [] ? copy_mount_options+0x39/0x1b0 [ 2049.692354] [] SyS_mount+0x83/0xd0 [ 2049.693939] [] system_call_fastpath+0x1f/0x24 [ 2049.695797] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2049.704698] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2049.732233] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2049.738678] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2049.743246] Call Trace: [ 2049.745890] [] dump_stack+0x19/0x1b [ 2049.747715] [] __schedule_bug+0x64/0x72 [ 2049.750947] [] __schedule+0x791/0x7d0 [ 2049.753915] [] __cond_resched+0x26/0x30 [ 2049.757976] [] _cond_resched+0x3a/0x50 [ 2049.761462] [] kmem_cache_alloc_trace+0x5c/0x2e0 [ 2049.770524] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 2049.780230] [] ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 2049.795698] [] ? do_raw_spin_unlock+0x49/0x90 [ 2049.805838] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2049.811220] [] mount_bdev+0x1b0/0x1f0 [ 2049.816237] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2049.826464] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2049.835787] [] mount_fs+0x39/0x1b0 [ 2049.840948] [] vfs_kern_mount+0x67/0x110 [ 2049.845964] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2049.856687] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2049.859477] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2049.862112] [] obd_setup+0x167/0x540 [obdclass] [ 2049.864482] [] class_setup+0x54f/0x830 [obdclass] [ 2049.866966] [] class_process_config+0x149b/0x2660 [obdclass] [ 2049.890938] [] ? __kmalloc+0x1e0/0x340 [ 2049.893518] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2049.896351] [] do_lcfg+0x263/0x520 [obdclass] [ 2049.898720] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2049.904147] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2049.909518] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2049.913208] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2049.916867] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2049.919980] [] mount_nodev+0x4d/0xb0 [ 2049.923320] [] lustre_mount+0x18/0x20 [lustre] [ 2049.925577] [] mount_fs+0x39/0x1b0 [ 2049.929376] [] vfs_kern_mount+0x67/0x110 [ 2049.932474] [] do_mount+0x1ef/0xce0 [ 2049.936600] [] ? copy_mount_options+0x39/0x1b0 [ 2049.939242] [] SyS_mount+0x83/0xd0 [ 2049.940937] [] system_call_fastpath+0x1f/0x24 [ 2049.942973] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2049.951187] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2050.013032] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2050.022716] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2050.030651] Call Trace: [ 2050.031840] [] dump_stack+0x19/0x1b [ 2050.037907] [] __schedule_bug+0x64/0x72 [ 2050.043644] [] __schedule+0x791/0x7d0 [ 2050.052625] [] schedule+0x29/0x70 [ 2050.061910] [] schedule_timeout+0x209/0x290 [ 2050.070094] [] ? native_smp_send_reschedule+0x4c/0x70 [ 2050.075843] [] ? resched_curr+0xd8/0xf0 [ 2050.082404] [] ? check_preempt_curr+0x80/0xa0 [ 2050.089124] [] ? ttwu_do_wakeup+0x19/0xf0 [ 2050.092136] [] wait_for_completion+0xfc/0x140 [ 2050.095946] [] ? wake_up_state+0x20/0x20 [ 2050.099831] [] kthread_create_on_node+0xa8/0x140 [ 2050.101637] [] ? commit_timeout+0x10/0x10 [jbd2] [ 2050.103280] [] jbd2_journal_load+0x16b/0x2d0 [jbd2] [ 2050.105136] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 2050.110264] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 2050.117407] [] ? do_raw_spin_unlock+0x49/0x90 [ 2050.119688] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2050.122056] [] mount_bdev+0x1b0/0x1f0 [ 2050.124017] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2050.126847] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2050.128448] [] mount_fs+0x39/0x1b0 [ 2050.132253] [] vfs_kern_mount+0x67/0x110 [ 2050.134782] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2050.144115] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2050.147471] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2050.149367] [] obd_setup+0x167/0x540 [obdclass] [ 2050.152228] [] class_setup+0x54f/0x830 [obdclass] [ 2050.154366] [] class_process_config+0x149b/0x2660 [obdclass] [ 2050.156583] [] ? __kmalloc+0x1e0/0x340 [ 2050.159221] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2050.165502] [] do_lcfg+0x263/0x520 [obdclass] [ 2050.167939] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2050.172857] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2050.177105] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2050.180325] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2050.186066] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2050.189410] [] mount_nodev+0x4d/0xb0 [ 2050.192679] [] lustre_mount+0x18/0x20 [lustre] [ 2050.194605] [] mount_fs+0x39/0x1b0 [ 2050.196511] [] vfs_kern_mount+0x67/0x110 [ 2050.200551] [] do_mount+0x1ef/0xce0 [ 2050.205592] [] ? copy_mount_options+0x39/0x1b0 [ 2050.210674] [] SyS_mount+0x83/0xd0 [ 2050.212491] [] system_call_fastpath+0x1f/0x24 [ 2050.215815] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2050.218843] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2050.240520] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2050.243692] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2050.245877] Call Trace: [ 2050.246510] [] dump_stack+0x19/0x1b [ 2050.250018] [] __schedule_bug+0x64/0x72 [ 2050.251622] [] __schedule+0x791/0x7d0 [ 2050.254671] [] schedule+0x29/0x70 [ 2050.256314] [] jbd2_journal_load+0x215/0x2d0 [jbd2] [ 2050.259121] [] ? wake_up_atomic_t+0x30/0x30 [ 2050.261337] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 2050.264159] [] ? do_raw_spin_unlock+0x49/0x90 [ 2050.267194] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2050.272249] [] mount_bdev+0x1b0/0x1f0 [ 2050.274874] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2050.280862] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2050.283859] [] mount_fs+0x39/0x1b0 [ 2050.285758] [] vfs_kern_mount+0x67/0x110 [ 2050.290591] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2050.298713] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2050.310030] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2050.318367] [] obd_setup+0x167/0x540 [obdclass] [ 2050.323129] [] class_setup+0x54f/0x830 [obdclass] [ 2050.326194] [] class_process_config+0x149b/0x2660 [obdclass] [ 2050.329939] [] ? __kmalloc+0x1e0/0x340 [ 2050.331766] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2050.335932] [] do_lcfg+0x263/0x520 [obdclass] [ 2050.338025] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2050.343221] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2050.347901] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2050.372148] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2050.378006] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2050.391839] [] mount_nodev+0x4d/0xb0 [ 2050.393711] [] lustre_mount+0x18/0x20 [lustre] [ 2050.406370] [] mount_fs+0x39/0x1b0 [ 2050.410590] [] vfs_kern_mount+0x67/0x110 [ 2050.412449] [] do_mount+0x1ef/0xce0 [ 2050.418268] [] ? copy_mount_options+0x39/0x1b0 [ 2050.424801] [] SyS_mount+0x83/0xd0 [ 2050.433210] [] system_call_fastpath+0x1f/0x24 [ 2050.435777] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2050.438454] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2050.487088] CPU: 2 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2050.491397] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2050.496289] Call Trace: [ 2050.497257] [] dump_stack+0x19/0x1b [ 2050.499117] [] __schedule_bug+0x64/0x72 [ 2050.500911] [] __schedule+0x791/0x7d0 [ 2050.502325] [] __cond_resched+0x26/0x30 [ 2050.504259] [] _cond_resched+0x3a/0x50 [ 2050.508396] [] __kmalloc+0x78/0x340 [ 2050.512259] [] ? __debug_object_init+0x249/0x480 [ 2050.519243] [] ? __alloc_workqueue_key+0x261/0x480 [ 2050.528643] [] __alloc_workqueue_key+0x261/0x480 [ 2050.537962] [] ? crc16+0x28/0x40 [ 2050.543307] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 2050.552246] [] mount_bdev+0x1b0/0x1f0 [ 2050.555667] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2050.558565] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2050.563348] [] mount_fs+0x39/0x1b0 [ 2050.565395] [] vfs_kern_mount+0x67/0x110 [ 2050.568041] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2050.572598] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2050.575335] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2050.584082] [] obd_setup+0x167/0x540 [obdclass] [ 2050.587799] [] class_setup+0x54f/0x830 [obdclass] [ 2050.590530] [] class_process_config+0x149b/0x2660 [obdclass] [ 2050.597657] [] ? __kmalloc+0x1e0/0x340 [ 2050.600597] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2050.604475] [] do_lcfg+0x263/0x520 [obdclass] [ 2050.609778] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2050.615098] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2050.617198] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2050.618958] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2050.620696] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2050.623109] [] mount_nodev+0x4d/0xb0 [ 2050.625987] [] lustre_mount+0x18/0x20 [lustre] [ 2050.632837] [] mount_fs+0x39/0x1b0 [ 2050.637330] [] vfs_kern_mount+0x67/0x110 [ 2050.638771] [] do_mount+0x1ef/0xce0 [ 2050.643920] [] ? copy_mount_options+0x39/0x1b0 [ 2050.647724] [] SyS_mount+0x83/0xd0 [ 2050.652162] [] system_call_fastpath+0x1f/0x24 [ 2050.656211] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2050.660399] in_atomic(): 1, irqs_disabled(): 0, pid: 18400, name: mount.lustre [ 2050.664886] CPU: 3 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2050.668958] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2050.673292] Call Trace: [ 2050.674221] [] dump_stack+0x19/0x1b [ 2050.679358] [] __might_sleep+0xd9/0x100 [ 2050.684545] [] kmem_cache_alloc_trace+0x57/0x2e0 [ 2050.687759] [] ? alloc_workqueue_attrs+0x2e/0xa0 [ 2050.690733] [] alloc_workqueue_attrs+0x2e/0xa0 [ 2050.694493] [] __alloc_workqueue_key+0x277/0x480 [ 2050.700695] [] ? crc16+0x28/0x40 [ 2050.703462] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 2050.708008] [] mount_bdev+0x1b0/0x1f0 [ 2050.715456] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2050.721629] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2050.726595] [] mount_fs+0x39/0x1b0 [ 2050.729954] [] vfs_kern_mount+0x67/0x110 [ 2050.731927] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2050.735636] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2050.739501] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2050.743888] [] obd_setup+0x167/0x540 [obdclass] [ 2050.749605] [] class_setup+0x54f/0x830 [obdclass] [ 2050.751771] [] class_process_config+0x149b/0x2660 [obdclass] [ 2050.757247] [] ? __kmalloc+0x1e0/0x340 [ 2050.759292] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2050.764955] [] do_lcfg+0x263/0x520 [obdclass] [ 2050.767662] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2050.770763] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2050.773831] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2050.776053] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2050.778384] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2050.781442] [] mount_nodev+0x4d/0xb0 [ 2050.784013] [] lustre_mount+0x18/0x20 [lustre] [ 2050.788400] [] mount_fs+0x39/0x1b0 [ 2050.790704] [] vfs_kern_mount+0x67/0x110 [ 2050.792715] [] do_mount+0x1ef/0xce0 [ 2050.794632] [] ? copy_mount_options+0x39/0x1b0 [ 2050.797450] [] SyS_mount+0x83/0xd0 [ 2050.799312] [] system_call_fastpath+0x1f/0x24 [ 2050.801453] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2050.803766] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2050.822888] CPU: 3 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2050.825657] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2050.830539] Call Trace: [ 2050.831297] [] dump_stack+0x19/0x1b [ 2050.834479] [] __schedule_bug+0x64/0x72 [ 2050.837061] [] __schedule+0x791/0x7d0 [ 2050.838450] [] __cond_resched+0x26/0x30 [ 2050.842322] [] _cond_resched+0x3a/0x50 [ 2050.844425] [] kmem_cache_alloc_trace+0x5c/0x2e0 [ 2050.846429] [] ? alloc_workqueue_attrs+0x2e/0xa0 [ 2050.848654] [] alloc_workqueue_attrs+0x2e/0xa0 [ 2050.853237] [] __alloc_workqueue_key+0x277/0x480 [ 2050.858303] [] ? crc16+0x28/0x40 [ 2050.860654] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 2050.865277] [] mount_bdev+0x1b0/0x1f0 [ 2050.867250] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2050.869819] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2050.871886] [] mount_fs+0x39/0x1b0 [ 2050.873520] [] vfs_kern_mount+0x67/0x110 [ 2050.875479] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2050.877315] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2050.879613] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2050.885563] [] obd_setup+0x167/0x540 [obdclass] [ 2050.889548] [] class_setup+0x54f/0x830 [obdclass] [ 2050.893647] [] class_process_config+0x149b/0x2660 [obdclass] [ 2050.898981] [] ? __kmalloc+0x1e0/0x340 [ 2050.904011] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2050.909290] [] do_lcfg+0x263/0x520 [obdclass] [ 2050.912493] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2050.916001] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2050.920569] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2050.923275] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2050.928923] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2050.931324] [] mount_nodev+0x4d/0xb0 [ 2050.935622] [] lustre_mount+0x18/0x20 [lustre] [ 2050.939457] [] mount_fs+0x39/0x1b0 [ 2050.947413] [] vfs_kern_mount+0x67/0x110 [ 2050.949127] [] do_mount+0x1ef/0xce0 [ 2050.951036] [] ? copy_mount_options+0x39/0x1b0 [ 2050.952944] [] SyS_mount+0x83/0xd0 [ 2050.954299] [] system_call_fastpath+0x1f/0x24 [ 2050.958416] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2050.960707] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2050.986256] CPU: 2 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2050.989042] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2050.999441] Call Trace: [ 2051.003048] [] dump_stack+0x19/0x1b [ 2051.005212] [] __schedule_bug+0x64/0x72 [ 2051.011963] [] __schedule+0x791/0x7d0 [ 2051.017053] [] ? enqueue_entity+0x2ef/0xc30 [ 2051.019116] [] schedule+0x29/0x70 [ 2051.025118] [] schedule_timeout+0x209/0x290 [ 2051.027053] [] wait_for_completion+0xfc/0x140 [ 2051.031238] [] ? wake_up_state+0x20/0x20 [ 2051.033927] [] kthread_create_on_node+0xa8/0x140 [ 2051.036231] [] ? process_one_work+0x4a0/0x4a0 [ 2051.038074] [] __alloc_workqueue_key+0x336/0x480 [ 2051.042283] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 2051.045067] [] mount_bdev+0x1b0/0x1f0 [ 2051.049326] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2051.054383] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2051.056765] [] mount_fs+0x39/0x1b0 [ 2051.058318] [] vfs_kern_mount+0x67/0x110 [ 2051.062564] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2051.068134] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2051.071367] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2051.077708] [] obd_setup+0x167/0x540 [obdclass] [ 2051.079846] [] class_setup+0x54f/0x830 [obdclass] [ 2051.082192] [] class_process_config+0x149b/0x2660 [obdclass] [ 2051.084706] [] ? __kmalloc+0x1e0/0x340 [ 2051.086490] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2051.088351] [] do_lcfg+0x263/0x520 [obdclass] [ 2051.094187] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2051.099469] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2051.101256] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2051.106645] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2051.112419] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2051.114363] [] mount_nodev+0x4d/0xb0 [ 2051.118257] [] lustre_mount+0x18/0x20 [lustre] [ 2051.120545] [] mount_fs+0x39/0x1b0 [ 2051.126172] [] vfs_kern_mount+0x67/0x110 [ 2051.127919] [] do_mount+0x1ef/0xce0 [ 2051.132287] [] ? copy_mount_options+0x39/0x1b0 [ 2051.136673] [] SyS_mount+0x83/0xd0 [ 2051.141447] [] system_call_fastpath+0x1f/0x24 [ 2051.147421] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2051.151999] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2051.179765] CPU: 2 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2051.184037] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2051.186443] Call Trace: [ 2051.187193] [] dump_stack+0x19/0x1b [ 2051.188908] [] __schedule_bug+0x64/0x72 [ 2051.190940] [] __schedule+0x791/0x7d0 [ 2051.204995] [] __cond_resched+0x26/0x30 [ 2051.209101] [] _cond_resched+0x3a/0x50 [ 2051.222958] [] mutex_lock+0x25/0x40 [ 2051.233010] [] __alloc_workqueue_key+0x1bd/0x480 [ 2051.239575] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 2051.244072] [] mount_bdev+0x1b0/0x1f0 [ 2051.248024] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2051.251085] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2051.253785] [] mount_fs+0x39/0x1b0 [ 2051.256481] [] vfs_kern_mount+0x67/0x110 [ 2051.260327] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2051.264295] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2051.267056] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2051.270010] [] obd_setup+0x167/0x540 [obdclass] [ 2051.273131] [] class_setup+0x54f/0x830 [obdclass] [ 2051.275685] [] class_process_config+0x149b/0x2660 [obdclass] [ 2051.278146] [] ? __kmalloc+0x1e0/0x340 [ 2051.281209] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2051.282978] [] do_lcfg+0x263/0x520 [obdclass] [ 2051.286683] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2051.293716] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2051.296719] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2051.300927] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2051.303025] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2051.304951] [] mount_nodev+0x4d/0xb0 [ 2051.309392] [] lustre_mount+0x18/0x20 [lustre] [ 2051.312836] [] mount_fs+0x39/0x1b0 [ 2051.315725] [] vfs_kern_mount+0x67/0x110 [ 2051.318823] [] do_mount+0x1ef/0xce0 [ 2051.321606] [] ? copy_mount_options+0x39/0x1b0 [ 2051.324880] [] SyS_mount+0x83/0xd0 [ 2051.326749] [] system_call_fastpath+0x1f/0x24 [ 2051.331967] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2051.336994] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2051.371900] CPU: 3 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2051.384995] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2051.391077] Call Trace: [ 2051.392603] [] dump_stack+0x19/0x1b [ 2051.393951] [] __schedule_bug+0x64/0x72 [ 2051.397310] [] __schedule+0x791/0x7d0 [ 2051.402141] [] ? bit_wait+0x50/0x50 [ 2051.404508] [] schedule+0x29/0x70 [ 2051.406125] [] schedule_timeout+0x209/0x290 [ 2051.408218] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 2051.421196] [] ? kvm_clock_read+0x33/0x40 [ 2051.423604] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2051.429027] [] ? ktime_get_ts64+0x4c/0xf0 [ 2051.435611] [] ? bit_wait+0x50/0x50 [ 2051.442344] [] io_schedule_timeout+0xad/0x130 [ 2051.445689] [] io_schedule+0x18/0x20 [ 2051.448953] [] bit_wait_io+0x11/0x50 [ 2051.451343] [] __wait_on_bit+0x65/0x90 [ 2051.453577] [] ? bit_wait+0x50/0x50 [ 2051.455579] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2051.458312] [] ? wake_bit_function+0x40/0x40 [ 2051.460947] [] __sync_dirty_buffer+0xe8/0x110 [ 2051.466887] [] sync_dirty_buffer+0x13/0x20 [ 2051.468800] [] ldiskfs_commit_super+0x1e0/0x280 [ldiskfs] [ 2051.473229] [] ldiskfs_setup_super+0x120/0x190 [ldiskfs] [ 2051.477636] [] ldiskfs_fill_super+0x2429/0x3060 [ldiskfs] [ 2051.486380] [] mount_bdev+0x1b0/0x1f0 [ 2051.490115] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2051.495875] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2051.500512] [] mount_fs+0x39/0x1b0 [ 2051.502622] [] vfs_kern_mount+0x67/0x110 [ 2051.506765] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2051.510601] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2051.514143] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2051.517049] [] obd_setup+0x167/0x540 [obdclass] [ 2051.520833] [] class_setup+0x54f/0x830 [obdclass] [ 2051.523652] [] class_process_config+0x149b/0x2660 [obdclass] [ 2051.526943] [] ? __kmalloc+0x1e0/0x340 [ 2051.529673] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2051.536706] [] do_lcfg+0x263/0x520 [obdclass] [ 2051.540898] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2051.545277] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2051.547602] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2051.550298] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2051.552589] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2051.554943] [] mount_nodev+0x4d/0xb0 [ 2051.557098] [] lustre_mount+0x18/0x20 [lustre] [ 2051.560345] [] mount_fs+0x39/0x1b0 [ 2051.562159] [] vfs_kern_mount+0x67/0x110 [ 2051.565458] [] do_mount+0x1ef/0xce0 [ 2051.574152] [] ? copy_mount_options+0x39/0x1b0 [ 2051.576244] [] SyS_mount+0x83/0xd0 [ 2051.578148] [] system_call_fastpath+0x1f/0x24 [ 2051.580827] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2051.583326] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2051.611940] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2051.617674] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2051.622957] Call Trace: [ 2051.623613] [] dump_stack+0x19/0x1b [ 2051.625501] [] __schedule_bug+0x64/0x72 [ 2051.628627] [] __schedule+0x791/0x7d0 [ 2051.630537] [] ? ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2051.633060] [] __cond_resched+0x26/0x30 [ 2051.634637] [] _cond_resched+0x3a/0x50 [ 2051.639725] [] kmem_cache_alloc+0x54/0x2e0 [ 2051.652306] [] ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2051.685295] [] ldiskfs_mb_init+0x53e/0x760 [ldiskfs] [ 2051.689246] [] ldiskfs_fill_super+0x2522/0x3060 [ldiskfs] [ 2051.692010] [] mount_bdev+0x1b0/0x1f0 [ 2051.694139] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2051.696743] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2051.699277] [] mount_fs+0x39/0x1b0 [ 2051.701355] [] vfs_kern_mount+0x67/0x110 [ 2051.703461] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2051.715533] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2051.722884] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2051.744017] [] obd_setup+0x167/0x540 [obdclass] [ 2051.751075] [] class_setup+0x54f/0x830 [obdclass] [ 2051.760307] [] class_process_config+0x149b/0x2660 [obdclass] [ 2051.770334] [] ? __kmalloc+0x1e0/0x340 [ 2051.778591] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2051.787922] [] do_lcfg+0x263/0x520 [obdclass] [ 2051.794494] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2051.803363] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2051.810816] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2051.822319] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2051.826057] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2051.831349] [] mount_nodev+0x4d/0xb0 [ 2051.838920] [] lustre_mount+0x18/0x20 [lustre] [ 2051.845367] [] mount_fs+0x39/0x1b0 [ 2051.852430] [] vfs_kern_mount+0x67/0x110 [ 2051.856862] [] do_mount+0x1ef/0xce0 [ 2051.866290] [] ? copy_mount_options+0x39/0x1b0 [ 2051.869298] [] SyS_mount+0x83/0xd0 [ 2051.876317] [] system_call_fastpath+0x1f/0x24 [ 2051.882351] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2051.886146] in_atomic(): 1, irqs_disabled(): 0, pid: 18400, name: mount.lustre [ 2051.891527] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2051.905058] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2051.918616] Call Trace: [ 2051.919484] [] dump_stack+0x19/0x1b [ 2051.929302] [] __might_sleep+0xd9/0x100 [ 2051.938169] [] kmem_cache_alloc+0x4f/0x2e0 [ 2051.945753] [] ? ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2051.949780] [] ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2051.953076] [] ldiskfs_mb_init+0x53e/0x760 [ldiskfs] [ 2051.957048] [] ldiskfs_fill_super+0x2522/0x3060 [ldiskfs] [ 2051.961094] [] mount_bdev+0x1b0/0x1f0 [ 2051.966308] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2051.970280] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2051.972044] [] mount_fs+0x39/0x1b0 [ 2051.973391] [] vfs_kern_mount+0x67/0x110 [ 2051.976233] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2051.982224] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2051.992553] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2052.004652] [] obd_setup+0x167/0x540 [obdclass] [ 2052.006820] [] class_setup+0x54f/0x830 [obdclass] [ 2052.009299] [] class_process_config+0x149b/0x2660 [obdclass] [ 2052.012108] [] ? __kmalloc+0x1e0/0x340 [ 2052.026341] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2052.037969] [] do_lcfg+0x263/0x520 [obdclass] [ 2052.040239] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2052.042871] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2052.048474] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2052.053285] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2052.062530] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2052.065938] [] mount_nodev+0x4d/0xb0 [ 2052.070219] [] lustre_mount+0x18/0x20 [lustre] [ 2052.074337] [] mount_fs+0x39/0x1b0 [ 2052.081145] [] vfs_kern_mount+0x67/0x110 [ 2052.086546] [] do_mount+0x1ef/0xce0 [ 2052.094041] [] ? copy_mount_options+0x39/0x1b0 [ 2052.104135] [] SyS_mount+0x83/0xd0 [ 2052.111021] [] system_call_fastpath+0x1f/0x24 [ 2052.118005] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2052.128029] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2052.209401] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2052.217054] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2052.222166] Call Trace: [ 2052.224711] [] dump_stack+0x19/0x1b [ 2052.227411] [] __schedule_bug+0x64/0x72 [ 2052.230887] [] __schedule+0x791/0x7d0 [ 2052.233863] [] ? ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2052.238369] [] __cond_resched+0x26/0x30 [ 2052.242960] [] _cond_resched+0x3a/0x50 [ 2052.245484] [] kmem_cache_alloc+0x54/0x2e0 [ 2052.253181] [] ? ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2052.263183] [] ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2052.275077] [] ldiskfs_mb_init+0x53e/0x760 [ldiskfs] [ 2052.287475] [] ldiskfs_fill_super+0x2522/0x3060 [ldiskfs] [ 2052.291241] [] mount_bdev+0x1b0/0x1f0 [ 2052.300016] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2052.307298] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2052.316338] [] mount_fs+0x39/0x1b0 [ 2052.324849] [] vfs_kern_mount+0x67/0x110 [ 2052.330403] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2052.338512] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2052.344000] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2052.349272] [] obd_setup+0x167/0x540 [obdclass] [ 2052.355039] [] class_setup+0x54f/0x830 [obdclass] [ 2052.358028] [] class_process_config+0x149b/0x2660 [obdclass] [ 2052.365180] [] ? __kmalloc+0x1e0/0x340 [ 2052.370163] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2052.378054] [] do_lcfg+0x263/0x520 [obdclass] [ 2052.380014] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2052.383250] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2052.385459] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2052.393036] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2052.395983] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2052.398226] [] mount_nodev+0x4d/0xb0 [ 2052.400809] [] lustre_mount+0x18/0x20 [lustre] [ 2052.404287] [] mount_fs+0x39/0x1b0 [ 2052.406135] [] vfs_kern_mount+0x67/0x110 [ 2052.408225] [] do_mount+0x1ef/0xce0 [ 2052.410196] [] ? copy_mount_options+0x39/0x1b0 [ 2052.412654] [] SyS_mount+0x83/0xd0 [ 2052.414760] [] system_call_fastpath+0x1f/0x24 [ 2052.419581] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2052.421487] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2052.454594] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2052.467720] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2052.473409] Call Trace: [ 2052.474723] [] dump_stack+0x19/0x1b [ 2052.477267] [] __schedule_bug+0x64/0x72 [ 2052.487902] [] __schedule+0x791/0x7d0 [ 2052.490958] [] ? ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2052.495394] [] __cond_resched+0x26/0x30 [ 2052.498513] [] _cond_resched+0x3a/0x50 [ 2052.500810] [] kmem_cache_alloc+0x54/0x2e0 [ 2052.503252] [] ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2052.507432] [] ldiskfs_mb_init+0x53e/0x760 [ldiskfs] [ 2052.513624] [] ldiskfs_fill_super+0x2522/0x3060 [ldiskfs] [ 2052.515939] [] mount_bdev+0x1b0/0x1f0 [ 2052.523738] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2052.526252] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2052.533951] [] mount_fs+0x39/0x1b0 [ 2052.545156] [] vfs_kern_mount+0x67/0x110 [ 2052.546876] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2052.551669] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2052.556899] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2052.562513] [] obd_setup+0x167/0x540 [obdclass] [ 2052.567618] [] class_setup+0x54f/0x830 [obdclass] [ 2052.572557] [] class_process_config+0x149b/0x2660 [obdclass] [ 2052.578886] [] ? __kmalloc+0x1e0/0x340 [ 2052.583767] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2052.586688] [] do_lcfg+0x263/0x520 [obdclass] [ 2052.589567] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2052.593043] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2052.598727] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2052.604779] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2052.611670] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2052.617363] [] mount_nodev+0x4d/0xb0 [ 2052.621202] [] lustre_mount+0x18/0x20 [lustre] [ 2052.624805] [] mount_fs+0x39/0x1b0 [ 2052.628242] [] vfs_kern_mount+0x67/0x110 [ 2052.631918] [] do_mount+0x1ef/0xce0 [ 2052.634814] [] ? copy_mount_options+0x39/0x1b0 [ 2052.638292] [] SyS_mount+0x83/0xd0 [ 2052.642871] [] system_call_fastpath+0x1f/0x24 [ 2052.647892] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2052.650669] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2052.722613] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2052.727207] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2052.731479] Call Trace: [ 2052.733398] [] dump_stack+0x19/0x1b [ 2052.736211] [] __schedule_bug+0x64/0x72 [ 2052.738313] [] __schedule+0x791/0x7d0 [ 2052.743182] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2052.746957] [] ? bit_wait+0x50/0x50 [ 2052.749034] [] schedule+0x29/0x70 [ 2052.750727] [] schedule_timeout+0x209/0x290 [ 2052.752395] [] ? kvm_clock_read+0x33/0x40 [ 2052.755376] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2052.757875] [] ? ktime_get_ts64+0x4c/0xf0 [ 2052.760566] [] ? bit_wait+0x50/0x50 [ 2052.762095] [] io_schedule_timeout+0xad/0x130 [ 2052.763899] [] io_schedule+0x18/0x20 [ 2052.766486] [] bit_wait_io+0x11/0x50 [ 2052.769068] [] __wait_on_bit+0x65/0x90 [ 2052.773507] [] ? bit_wait+0x50/0x50 [ 2052.775395] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2052.780024] [] ? wake_bit_function+0x40/0x40 [ 2052.784183] [] __wait_on_buffer+0x2a/0x30 [ 2052.788349] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2052.793311] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2052.797482] [] v2_read_header+0x1f/0x50 [ 2052.806356] [] v2_check_quota_file+0x2b/0x70 [ 2052.808510] [] ? igrab+0x36/0x60 [ 2052.820288] [] vfs_load_quota_inode+0x279/0x570 [ 2052.829017] [] ? unlock_new_inode+0x55/0x80 [ 2052.835431] [] dquot_enable+0xf0/0x110 [ 2052.839021] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 2052.844274] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 2052.848532] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 2052.853883] [] mount_bdev+0x1b0/0x1f0 [ 2052.857424] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2052.859771] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2052.862727] [] mount_fs+0x39/0x1b0 [ 2052.864452] [] vfs_kern_mount+0x67/0x110 [ 2052.870173] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2052.872991] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2052.876618] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2052.888506] [] obd_setup+0x167/0x540 [obdclass] [ 2052.890798] [] class_setup+0x54f/0x830 [obdclass] [ 2052.892815] [] class_process_config+0x149b/0x2660 [obdclass] [ 2052.894787] [] ? __kmalloc+0x1e0/0x340 [ 2052.896615] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2052.898848] [] do_lcfg+0x263/0x520 [obdclass] [ 2052.901093] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2052.903645] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2052.906131] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2052.908621] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2052.930372] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2052.941985] [] mount_nodev+0x4d/0xb0 [ 2052.952136] [] lustre_mount+0x18/0x20 [lustre] [ 2052.962328] [] mount_fs+0x39/0x1b0 [ 2052.970031] [] vfs_kern_mount+0x67/0x110 [ 2052.977423] [] do_mount+0x1ef/0xce0 [ 2052.985942] [] ? copy_mount_options+0x39/0x1b0 [ 2052.996850] [] SyS_mount+0x83/0xd0 [ 2053.006126] [] system_call_fastpath+0x1f/0x24 [ 2053.007903] BUG: sleeping function called from invalid context at kernel/mutex.c:104 [ 2053.014905] in_atomic(): 1, irqs_disabled(): 0, pid: 18400, name: mount.lustre [ 2053.029509] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2053.040328] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2053.044551] Call Trace: [ 2053.046567] [] dump_stack+0x19/0x1b [ 2053.049156] [] __might_sleep+0xd9/0x100 [ 2053.053064] [] mutex_lock+0x20/0x40 [ 2053.055585] [] vfs_load_quota_inode+0x2d8/0x570 [ 2053.059827] [] dquot_enable+0xf0/0x110 [ 2053.063224] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 2053.066468] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 2053.070137] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 2053.074834] [] mount_bdev+0x1b0/0x1f0 [ 2053.077686] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2053.085973] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2053.093686] [] mount_fs+0x39/0x1b0 [ 2053.100130] [] vfs_kern_mount+0x67/0x110 [ 2053.105262] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2053.109018] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2053.111359] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2053.113606] [] obd_setup+0x167/0x540 [obdclass] [ 2053.117859] [] class_setup+0x54f/0x830 [obdclass] [ 2053.120651] [] class_process_config+0x149b/0x2660 [obdclass] [ 2053.123592] [] ? __kmalloc+0x1e0/0x340 [ 2053.126135] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2053.129280] [] do_lcfg+0x263/0x520 [obdclass] [ 2053.133399] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2053.138710] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2053.143733] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2053.147370] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2053.153874] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2053.160746] [] mount_nodev+0x4d/0xb0 [ 2053.163973] [] lustre_mount+0x18/0x20 [lustre] [ 2053.168146] [] mount_fs+0x39/0x1b0 [ 2053.170151] [] vfs_kern_mount+0x67/0x110 [ 2053.173057] [] do_mount+0x1ef/0xce0 [ 2053.176311] [] ? copy_mount_options+0x39/0x1b0 [ 2053.180161] [] SyS_mount+0x83/0xd0 [ 2053.182007] [] system_call_fastpath+0x1f/0x24 [ 2053.184269] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2053.190332] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2053.244561] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2053.250967] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2053.255698] Call Trace: [ 2053.257415] [] dump_stack+0x19/0x1b [ 2053.263733] [] __schedule_bug+0x64/0x72 [ 2053.268764] [] __schedule+0x791/0x7d0 [ 2053.273911] [] __cond_resched+0x26/0x30 [ 2053.275830] [] _cond_resched+0x3a/0x50 [ 2053.277091] [] mutex_lock+0x25/0x40 [ 2053.278257] [] vfs_load_quota_inode+0x2d8/0x570 [ 2053.287123] [] dquot_enable+0xf0/0x110 [ 2053.290184] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 2053.295872] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 2053.302132] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 2053.305233] [] mount_bdev+0x1b0/0x1f0 [ 2053.307961] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2053.311223] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2053.314995] [] mount_fs+0x39/0x1b0 [ 2053.317543] [] vfs_kern_mount+0x67/0x110 [ 2053.320245] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2053.323894] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2053.328543] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2053.331508] [] obd_setup+0x167/0x540 [obdclass] [ 2053.336314] [] class_setup+0x54f/0x830 [obdclass] [ 2053.342764] [] class_process_config+0x149b/0x2660 [obdclass] [ 2053.349370] [] ? __kmalloc+0x1e0/0x340 [ 2053.357131] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2053.361306] [] do_lcfg+0x263/0x520 [obdclass] [ 2053.363108] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2053.366472] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2053.369062] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2053.372428] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2053.378332] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2053.382018] [] mount_nodev+0x4d/0xb0 [ 2053.384115] [] lustre_mount+0x18/0x20 [lustre] [ 2053.388756] [] mount_fs+0x39/0x1b0 [ 2053.396269] [] vfs_kern_mount+0x67/0x110 [ 2053.402764] [] do_mount+0x1ef/0xce0 [ 2053.407041] [] ? copy_mount_options+0x39/0x1b0 [ 2053.415573] [] SyS_mount+0x83/0xd0 [ 2053.417530] [] system_call_fastpath+0x1f/0x24 [ 2053.425708] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2053.428572] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2053.475763] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2053.492374] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2053.499354] Call Trace: [ 2053.500308] [] dump_stack+0x19/0x1b [ 2053.501859] [] __schedule_bug+0x64/0x72 [ 2053.504407] [] __schedule+0x791/0x7d0 [ 2053.506051] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2053.510103] [] ? bit_wait+0x50/0x50 [ 2053.512448] [] schedule+0x29/0x70 [ 2053.515373] [] schedule_timeout+0x209/0x290 [ 2053.517564] [] ? kvm_clock_read+0x33/0x40 [ 2053.519461] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2053.522437] [] ? ktime_get_ts64+0x4c/0xf0 [ 2053.524530] [] ? bit_wait+0x50/0x50 [ 2053.526252] [] io_schedule_timeout+0xad/0x130 [ 2053.528299] [] io_schedule+0x18/0x20 [ 2053.529808] [] bit_wait_io+0x11/0x50 [ 2053.533579] [] __wait_on_bit+0x65/0x90 [ 2053.536235] [] ? bit_wait+0x50/0x50 [ 2053.537474] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2053.539064] [] ? wake_bit_function+0x40/0x40 [ 2053.540762] [] __wait_on_buffer+0x2a/0x30 [ 2053.542248] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2053.543972] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2053.546197] [] v2_read_header+0x1f/0x50 [ 2053.558015] [] v2_check_quota_file+0x2b/0x70 [ 2053.563213] [] ? igrab+0x36/0x60 [ 2053.570222] [] vfs_load_quota_inode+0x279/0x570 [ 2053.577691] [] ? unlock_new_inode+0x55/0x80 [ 2053.579781] [] dquot_enable+0xf0/0x110 [ 2053.581350] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 2053.589061] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 2053.594964] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 2053.597506] [] mount_bdev+0x1b0/0x1f0 [ 2053.600119] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2053.602870] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2053.605342] [] mount_fs+0x39/0x1b0 [ 2053.607873] [] vfs_kern_mount+0x67/0x110 [ 2053.612014] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2053.616923] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2053.620183] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2053.623608] [] obd_setup+0x167/0x540 [obdclass] [ 2053.627387] [] class_setup+0x54f/0x830 [obdclass] [ 2053.629987] [] class_process_config+0x149b/0x2660 [obdclass] [ 2053.634207] [] ? __kmalloc+0x1e0/0x340 [ 2053.636143] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2053.638199] [] do_lcfg+0x263/0x520 [obdclass] [ 2053.640252] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2053.642756] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2053.646062] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2053.649671] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2053.658141] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2053.662175] [] mount_nodev+0x4d/0xb0 [ 2053.665298] [] lustre_mount+0x18/0x20 [lustre] [ 2053.668918] [] mount_fs+0x39/0x1b0 [ 2053.671398] [] vfs_kern_mount+0x67/0x110 [ 2053.674654] [] do_mount+0x1ef/0xce0 [ 2053.677189] [] ? copy_mount_options+0x39/0x1b0 [ 2053.680101] [] SyS_mount+0x83/0xd0 [ 2053.681401] [] system_call_fastpath+0x1f/0x24 [ 2053.687250] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2053.689800] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2053.736677] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2053.748371] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2053.761815] Call Trace: [ 2053.765696] [] dump_stack+0x19/0x1b [ 2053.768955] [] __schedule_bug+0x64/0x72 [ 2053.780590] [] __schedule+0x791/0x7d0 [ 2053.782465] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2053.785183] [] ? bit_wait+0x50/0x50 [ 2053.787302] [] schedule+0x29/0x70 [ 2053.790163] [] schedule_timeout+0x209/0x290 [ 2053.792058] [] ? kvm_clock_read+0x33/0x40 [ 2053.793519] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2053.796990] [] ? ktime_get_ts64+0x4c/0xf0 [ 2053.799620] [] ? bit_wait+0x50/0x50 [ 2053.803247] [] io_schedule_timeout+0xad/0x130 [ 2053.806936] [] io_schedule+0x18/0x20 [ 2053.810470] [] bit_wait_io+0x11/0x50 [ 2053.815617] [] __wait_on_bit+0x65/0x90 [ 2053.817758] [] ? bit_wait+0x50/0x50 [ 2053.821525] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2053.824555] [] ? wake_bit_function+0x40/0x40 [ 2053.831927] [] __wait_on_buffer+0x2a/0x30 [ 2053.833924] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2053.836077] [] ? mark_page_accessed+0xd8/0xe0 [ 2053.838256] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2053.840696] [] v2_read_header+0x1f/0x50 [ 2053.842782] [] v2_check_quota_file+0x2b/0x70 [ 2053.849771] [] ? igrab+0x36/0x60 [ 2053.853153] [] vfs_load_quota_inode+0x279/0x570 [ 2053.857595] [] ? unlock_new_inode+0x55/0x80 [ 2053.862190] [] dquot_enable+0xf0/0x110 [ 2053.865286] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 2053.869195] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 2053.872378] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 2053.878436] [] mount_bdev+0x1b0/0x1f0 [ 2053.882737] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2053.889653] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2053.892290] [] mount_fs+0x39/0x1b0 [ 2053.897065] [] vfs_kern_mount+0x67/0x110 [ 2053.899224] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2053.903787] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2053.907915] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2053.916527] [] obd_setup+0x167/0x540 [obdclass] [ 2053.919205] [] class_setup+0x54f/0x830 [obdclass] [ 2053.923996] [] class_process_config+0x149b/0x2660 [obdclass] [ 2053.928082] [] ? __kmalloc+0x1e0/0x340 [ 2053.934186] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2053.937459] [] do_lcfg+0x263/0x520 [obdclass] [ 2053.940910] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2053.943387] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2053.947974] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2053.952393] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2053.954980] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2053.959052] [] mount_nodev+0x4d/0xb0 [ 2053.962927] [] lustre_mount+0x18/0x20 [lustre] [ 2053.965339] [] mount_fs+0x39/0x1b0 [ 2053.966945] [] vfs_kern_mount+0x67/0x110 [ 2053.969003] [] do_mount+0x1ef/0xce0 [ 2053.971059] [] ? copy_mount_options+0x39/0x1b0 [ 2053.973059] [] SyS_mount+0x83/0xd0 [ 2053.974840] [] system_call_fastpath+0x1f/0x24 [ 2053.980938] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2053.984907] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2053.987094] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2054.021426] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2054.029389] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2054.042693] Call Trace: [ 2054.046606] [] dump_stack+0x19/0x1b [ 2054.051081] [] __schedule_bug+0x64/0x72 [ 2054.056744] [] __schedule+0x791/0x7d0 [ 2054.063510] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2054.069999] [] ? bit_wait+0x50/0x50 [ 2054.076838] [] schedule+0x29/0x70 [ 2054.083432] [] schedule_timeout+0x209/0x290 [ 2054.091723] [] ? kvm_clock_read+0x33/0x40 [ 2054.099522] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2054.102062] [] ? ktime_get_ts64+0x4c/0xf0 [ 2054.113102] [] ? bit_wait+0x50/0x50 [ 2054.119988] [] io_schedule_timeout+0xad/0x130 [ 2054.125518] [] io_schedule+0x18/0x20 [ 2054.127296] [] bit_wait_io+0x11/0x50 [ 2054.129221] [] __wait_on_bit+0x65/0x90 [ 2054.131002] [] ? bit_wait+0x50/0x50 [ 2054.132813] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2054.134687] [] ? wake_bit_function+0x40/0x40 [ 2054.136568] [] __wait_on_buffer+0x2a/0x30 [ 2054.138382] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2054.140540] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2054.152050] [] read_blk+0x4c/0x60 [ 2054.153602] [] find_tree_dqentry+0x47/0x240 [ 2054.164599] [] find_tree_dqentry+0x1aa/0x240 [ 2054.171062] [] find_tree_dqentry+0x1aa/0x240 [ 2054.176441] [] find_tree_dqentry+0x1aa/0x240 [ 2054.181189] [] qtree_read_dquot+0x14c/0x380 [ 2054.185844] [] v2_read_dquot+0x2b/0x30 [ 2054.192358] [] dquot_acquire+0xe4/0x130 [ 2054.197625] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2054.201705] [] dqget+0x3fb/0x460 [ 2054.203300] [] __dquot_initialize+0x12d/0x230 [ 2054.204890] [] ? free_pages.part.76+0x40/0x50 [ 2054.208904] [] dquot_initialize+0x13/0x20 [ 2054.213876] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2054.215961] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2054.217912] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2054.220150] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2054.221966] [] obd_setup+0x167/0x540 [obdclass] [ 2054.223811] [] class_setup+0x54f/0x830 [obdclass] [ 2054.225678] [] class_process_config+0x149b/0x2660 [obdclass] [ 2054.228132] [] ? __kmalloc+0x1e0/0x340 [ 2054.229956] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2054.232102] [] do_lcfg+0x263/0x520 [obdclass] [ 2054.237265] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2054.256585] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2054.258997] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2054.261434] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2054.274375] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2054.278845] [] mount_nodev+0x4d/0xb0 [ 2054.282261] [] lustre_mount+0x18/0x20 [lustre] [ 2054.286438] [] mount_fs+0x39/0x1b0 [ 2054.290424] [] vfs_kern_mount+0x67/0x110 [ 2054.292860] [] do_mount+0x1ef/0xce0 [ 2054.294338] [] ? copy_mount_options+0x39/0x1b0 [ 2054.298896] [] SyS_mount+0x83/0xd0 [ 2054.300895] [] system_call_fastpath+0x1f/0x24 [ 2054.302851] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2054.305787] in_atomic(): 1, irqs_disabled(): 0, pid: 18400, name: mount.lustre [ 2054.314350] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2054.321557] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2054.327705] Call Trace: [ 2054.329581] [] dump_stack+0x19/0x1b [ 2054.333727] [] __might_sleep+0xd9/0x100 [ 2054.337107] [] __kmalloc+0x73/0x340 [ 2054.338878] [] ? getdqbuf+0x14/0x40 [ 2054.340659] [] getdqbuf+0x14/0x40 [ 2054.342503] [] find_tree_dqentry+0xaf/0x240 [ 2054.344736] [] find_tree_dqentry+0x1aa/0x240 [ 2054.347945] [] find_tree_dqentry+0x1aa/0x240 [ 2054.351949] [] find_tree_dqentry+0x1aa/0x240 [ 2054.354933] [] qtree_read_dquot+0x14c/0x380 [ 2054.356963] [] v2_read_dquot+0x2b/0x30 [ 2054.362929] [] dquot_acquire+0xe4/0x130 [ 2054.364919] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2054.369983] [] dqget+0x3fb/0x460 [ 2054.372762] [] __dquot_initialize+0x12d/0x230 [ 2054.376975] [] ? free_pages.part.76+0x40/0x50 [ 2054.379085] [] dquot_initialize+0x13/0x20 [ 2054.383194] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2054.388486] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2054.391123] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2054.396914] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2054.399387] [] obd_setup+0x167/0x540 [obdclass] [ 2054.405188] [] class_setup+0x54f/0x830 [obdclass] [ 2054.408673] [] class_process_config+0x149b/0x2660 [obdclass] [ 2054.413237] [] ? __kmalloc+0x1e0/0x340 [ 2054.415151] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2054.417376] [] do_lcfg+0x263/0x520 [obdclass] [ 2054.419425] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2054.421637] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2054.423945] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2054.426038] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2054.428168] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2054.430301] [] mount_nodev+0x4d/0xb0 [ 2054.431894] [] lustre_mount+0x18/0x20 [lustre] [ 2054.433948] [] mount_fs+0x39/0x1b0 [ 2054.437180] [] vfs_kern_mount+0x67/0x110 [ 2054.440898] [] do_mount+0x1ef/0xce0 [ 2054.446630] [] ? copy_mount_options+0x39/0x1b0 [ 2054.450931] [] SyS_mount+0x83/0xd0 [ 2054.455842] [] system_call_fastpath+0x1f/0x24 [ 2054.459152] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2054.466592] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2054.489844] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2054.495826] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2054.500866] Call Trace: [ 2054.503562] [] dump_stack+0x19/0x1b [ 2054.519724] [] __schedule_bug+0x64/0x72 [ 2054.525965] [] __schedule+0x791/0x7d0 [ 2054.527489] [] __cond_resched+0x26/0x30 [ 2054.565273] [] _cond_resched+0x3a/0x50 [ 2054.567343] [] __kmalloc+0x78/0x340 [ 2054.569147] [] ? getdqbuf+0x14/0x40 [ 2054.571006] [] getdqbuf+0x14/0x40 [ 2054.577484] [] find_tree_dqentry+0xaf/0x240 [ 2054.579411] [] find_tree_dqentry+0x1aa/0x240 [ 2054.588035] [] find_tree_dqentry+0x1aa/0x240 [ 2054.593022] [] find_tree_dqentry+0x1aa/0x240 [ 2054.595001] [] qtree_read_dquot+0x14c/0x380 [ 2054.600985] [] v2_read_dquot+0x2b/0x30 [ 2054.602862] [] dquot_acquire+0xe4/0x130 [ 2054.604800] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2054.623332] [] dqget+0x3fb/0x460 [ 2054.627112] [] __dquot_initialize+0x12d/0x230 [ 2054.629667] [] ? free_pages.part.76+0x40/0x50 [ 2054.633570] [] dquot_initialize+0x13/0x20 [ 2054.636180] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2054.640858] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2054.642837] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2054.644904] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2054.662052] [] obd_setup+0x167/0x540 [obdclass] [ 2054.666044] [] class_setup+0x54f/0x830 [obdclass] [ 2054.671680] [] class_process_config+0x149b/0x2660 [obdclass] [ 2054.677360] [] ? __kmalloc+0x1e0/0x340 [ 2054.680816] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2054.682872] [] do_lcfg+0x263/0x520 [obdclass] [ 2054.684770] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2054.710178] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2054.712795] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2054.716820] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2054.722221] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2054.730856] [] mount_nodev+0x4d/0xb0 [ 2054.744474] [] lustre_mount+0x18/0x20 [lustre] [ 2054.749261] [] mount_fs+0x39/0x1b0 [ 2054.757009] [] vfs_kern_mount+0x67/0x110 [ 2054.763061] [] do_mount+0x1ef/0xce0 [ 2054.767653] [] ? copy_mount_options+0x39/0x1b0 [ 2054.779549] [] SyS_mount+0x83/0xd0 [ 2054.782497] [] system_call_fastpath+0x1f/0x24 [ 2054.786138] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2054.792911] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2054.822467] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2054.827547] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2054.830524] Call Trace: [ 2054.831449] [] dump_stack+0x19/0x1b [ 2054.833020] [] __schedule_bug+0x64/0x72 [ 2054.834926] [] __schedule+0x791/0x7d0 [ 2054.836636] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2054.840253] [] ? bit_wait+0x50/0x50 [ 2054.843149] [] schedule+0x29/0x70 [ 2054.845089] [] schedule_timeout+0x209/0x290 [ 2054.846857] [] ? kvm_clock_read+0x33/0x40 [ 2054.850262] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2054.852188] [] ? ktime_get_ts64+0x4c/0xf0 [ 2054.857044] [] ? bit_wait+0x50/0x50 [ 2054.859229] [] io_schedule_timeout+0xad/0x130 [ 2054.861890] [] io_schedule+0x18/0x20 [ 2054.864061] [] bit_wait_io+0x11/0x50 [ 2054.867206] [] __wait_on_bit+0x65/0x90 [ 2054.871322] [] ? bit_wait+0x50/0x50 [ 2054.873270] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2054.875964] [] ? wake_bit_function+0x40/0x40 [ 2054.880696] [] __wait_on_buffer+0x2a/0x30 [ 2054.883897] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2054.888305] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2054.890770] [] read_blk+0x4c/0x60 [ 2054.892514] [] find_tree_dqentry+0x47/0x240 [ 2054.894707] [] find_tree_dqentry+0x1aa/0x240 [ 2054.896672] [] find_tree_dqentry+0x1aa/0x240 [ 2054.901307] [] find_tree_dqentry+0x1aa/0x240 [ 2054.912670] [] qtree_read_dquot+0x14c/0x380 [ 2054.916415] [] v2_read_dquot+0x2b/0x30 [ 2054.918405] [] dquot_acquire+0xe4/0x130 [ 2054.922098] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2054.927582] [] dqget+0x3fb/0x460 [ 2054.930630] [] __dquot_initialize+0x12d/0x230 [ 2054.934469] [] dquot_initialize+0x13/0x20 [ 2054.940337] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2054.949399] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2054.955436] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2054.963002] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2054.967673] [] obd_setup+0x167/0x540 [obdclass] [ 2054.971235] [] class_setup+0x54f/0x830 [obdclass] [ 2054.976199] [] class_process_config+0x149b/0x2660 [obdclass] [ 2054.980374] [] ? __kmalloc+0x1e0/0x340 [ 2054.982494] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2054.988866] [] do_lcfg+0x263/0x520 [obdclass] [ 2054.992537] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2054.998722] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2055.002317] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2055.005946] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2055.008766] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2055.011414] [] mount_nodev+0x4d/0xb0 [ 2055.013619] [] lustre_mount+0x18/0x20 [lustre] [ 2055.018274] [] mount_fs+0x39/0x1b0 [ 2055.022430] [] vfs_kern_mount+0x67/0x110 [ 2055.025694] [] do_mount+0x1ef/0xce0 [ 2055.028520] [] ? copy_mount_options+0x39/0x1b0 [ 2055.031147] [] SyS_mount+0x83/0xd0 [ 2055.034466] [] system_call_fastpath+0x1f/0x24 [ 2055.038055] BUG: scheduling while atomic: mount.lustre/18400/0x00000002 [ 2055.040490] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2055.074473] CPU: 1 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2055.078653] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2055.082897] Call Trace: [ 2055.083568] [] dump_stack+0x19/0x1b [ 2055.088220] [] __schedule_bug+0x64/0x72 [ 2055.092602] [] __schedule+0x791/0x7d0 [ 2055.096579] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2055.102530] [] ? bit_wait+0x50/0x50 [ 2055.105168] [] schedule+0x29/0x70 [ 2055.106795] [] schedule_timeout+0x209/0x290 [ 2055.108908] [] ? kvm_clock_read+0x33/0x40 [ 2055.114002] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2055.117190] [] ? ktime_get_ts64+0x4c/0xf0 [ 2055.120426] [] ? bit_wait+0x50/0x50 [ 2055.124811] [] io_schedule_timeout+0xad/0x130 [ 2055.127257] [] io_schedule+0x18/0x20 [ 2055.130231] [] bit_wait_io+0x11/0x50 [ 2055.136156] [] __wait_on_bit+0x65/0x90 [ 2055.142073] [] ? bit_wait+0x50/0x50 [ 2055.148185] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2055.151674] [] ? wake_bit_function+0x40/0x40 [ 2055.155037] [] __wait_on_buffer+0x2a/0x30 [ 2055.158416] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2055.162513] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2055.167893] [] read_blk+0x4c/0x60 [ 2055.175702] [] find_tree_dqentry+0x47/0x240 [ 2055.184089] [] find_tree_dqentry+0x1aa/0x240 [ 2055.190018] [] find_tree_dqentry+0x1aa/0x240 [ 2055.199391] [] find_tree_dqentry+0x1aa/0x240 [ 2055.209320] [] qtree_read_dquot+0x14c/0x380 [ 2055.212461] [] v2_read_dquot+0x2b/0x30 [ 2055.215242] [] dquot_acquire+0xe4/0x130 [ 2055.218672] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2055.228066] [] dqget+0x3fb/0x460 [ 2055.232871] [] __dquot_initialize+0x12d/0x230 [ 2055.236678] [] dquot_initialize+0x13/0x20 [ 2055.243387] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2055.271575] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2055.274221] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2055.276525] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2055.287622] [] obd_setup+0x167/0x540 [obdclass] [ 2055.295591] [] class_setup+0x54f/0x830 [obdclass] [ 2055.311361] [] class_process_config+0x149b/0x2660 [obdclass] [ 2055.313791] [] ? __kmalloc+0x1e0/0x340 [ 2055.315369] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2055.330993] [] do_lcfg+0x263/0x520 [obdclass] [ 2055.336590] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2055.340174] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2055.343517] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2055.346184] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2055.348325] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2055.354056] [] mount_nodev+0x4d/0xb0 [ 2055.359163] [] lustre_mount+0x18/0x20 [lustre] [ 2055.367553] [] mount_fs+0x39/0x1b0 [ 2055.371532] [] vfs_kern_mount+0x67/0x110 [ 2055.378181] [] do_mount+0x1ef/0xce0 [ 2055.379833] [] ? copy_mount_options+0x39/0x1b0 [ 2055.381597] [] SyS_mount+0x83/0xd0 [ 2055.383394] [] system_call_fastpath+0x1f/0x24 [ 2055.395571] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2055.403513] in_atomic(): 1, irqs_disabled(): 0, pid: 18400, name: mount.lustre [ 2055.409455] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2055.417212] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2055.425441] Call Trace: [ 2055.430745] [] dump_stack+0x19/0x1b [ 2055.432514] [] __might_sleep+0xd9/0x100 [ 2055.434406] [] __kmalloc+0x73/0x340 [ 2055.441593] [] ? getdqbuf+0x14/0x40 [ 2055.448977] [] getdqbuf+0x14/0x40 [ 2055.451677] [] find_tree_dqentry+0xaf/0x240 [ 2055.456636] [] find_tree_dqentry+0x1aa/0x240 [ 2055.463078] [] find_tree_dqentry+0x1aa/0x240 [ 2055.474305] [] find_tree_dqentry+0x1aa/0x240 [ 2055.482623] [] qtree_read_dquot+0x14c/0x380 [ 2055.492393] [] v2_read_dquot+0x2b/0x30 [ 2055.500926] [] dquot_acquire+0xe4/0x130 [ 2055.506602] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2055.516867] [] dqget+0x3fb/0x460 [ 2055.522133] [] __dquot_initialize+0x12d/0x230 [ 2055.532375] [] dquot_initialize+0x13/0x20 [ 2055.544570] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2055.549562] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2055.554508] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2055.562776] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2055.573842] [] obd_setup+0x167/0x540 [obdclass] [ 2055.581381] [] class_setup+0x54f/0x830 [obdclass] [ 2055.588132] [] class_process_config+0x149b/0x2660 [obdclass] [ 2055.594851] [] ? __kmalloc+0x1e0/0x340 [ 2055.601653] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2055.610136] [] do_lcfg+0x263/0x520 [obdclass] [ 2055.618642] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2055.631103] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2055.642673] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2055.652006] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2055.654301] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2055.656508] [] mount_nodev+0x4d/0xb0 [ 2055.659616] [] lustre_mount+0x18/0x20 [lustre] [ 2055.667719] [] mount_fs+0x39/0x1b0 [ 2055.670222] [] vfs_kern_mount+0x67/0x110 [ 2055.672851] [] do_mount+0x1ef/0xce0 [ 2055.679047] [] ? copy_mount_options+0x39/0x1b0 [ 2055.683812] [] SyS_mount+0x83/0xd0 [ 2055.685679] [] system_call_fastpath+0x1f/0x24 [ 2055.689611] BUG: scheduling while atomic: mount.lustre/18400/0x10000002 [ 2055.694305] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2055.727388] CPU: 0 PID: 18400 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2055.738347] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2055.743325] Call Trace: [ 2055.747209] [] dump_stack+0x19/0x1b [ 2055.751815] [] __schedule_bug+0x64/0x72 [ 2055.758249] [] __schedule+0x791/0x7d0 [ 2055.765147] [] __cond_resched+0x26/0x30 [ 2055.767282] [] _cond_resched+0x3a/0x50 [ 2055.781558] [] __kmalloc+0x78/0x340 [ 2055.797419] [] ? getdqbuf+0x14/0x40 [ 2055.799230] [] getdqbuf+0x14/0x40 [ 2055.808868] [] find_tree_dqentry+0xaf/0x240 [ 2055.814562] [] find_tree_dqentry+0x1aa/0x240 [ 2055.820992] [] find_tree_dqentry+0x1aa/0x240 [ 2055.827038] [] find_tree_dqentry+0x1aa/0x240 [ 2055.838872] [] qtree_read_dquot+0x14c/0x380 [ 2055.845080] [] v2_read_dquot+0x2b/0x30 [ 2055.852589] [] dquot_acquire+0xe4/0x130 [ 2055.854688] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2055.859586] [] dqget+0x3fb/0x460 [ 2055.869086] [] __dquot_initialize+0x12d/0x230 [ 2055.870991] [] dquot_initialize+0x13/0x20 [ 2055.883266] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2055.891974] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2055.893639] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2055.897144] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2055.906926] [] obd_setup+0x167/0x540 [obdclass] [ 2055.909267] [] class_setup+0x54f/0x830 [obdclass] [ 2055.911365] [] class_process_config+0x149b/0x2660 [obdclass] [ 2055.913316] [] ? __kmalloc+0x1e0/0x340 [ 2055.915027] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2055.917851] [] do_lcfg+0x263/0x520 [obdclass] [ 2055.920490] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2055.924890] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2055.932070] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2055.945009] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2055.954596] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2055.963022] [] mount_nodev+0x4d/0xb0 [ 2055.967659] [] lustre_mount+0x18/0x20 [lustre] [ 2055.972339] [] mount_fs+0x39/0x1b0 [ 2055.977651] [] vfs_kern_mount+0x67/0x110 [ 2055.983613] [] do_mount+0x1ef/0xce0 [ 2055.988380] [] ? copy_mount_options+0x39/0x1b0 [ 2055.998260] [] SyS_mount+0x83/0xd0 [ 2056.007409] [] system_call_fastpath+0x1f/0x24 [ 2056.374246] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2056.446046] Lustre: lustre-MDT0001: in recovery but waiting for the first client to connect [ 2057.600393] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 2058.678496] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2061.378011] Lustre: lustre-MDT0001-lwp-OST0001: Connection restored to (at 0@lo) [ 2061.383962] Lustre: Skipped 3 previous similar messages [ 2061.402682] Lustre: lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [ 2061.437774] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:33) [ 2063.486642] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 [ 2066.522711] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 [ 2069.730128] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 [ 2072.932725] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 [ 2075.794378] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 [ 2078.637704] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 [ 2201.611814] Lustre: Failing over lustre-MDT0001 [ 2201.721099] LustreError: 21231:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 2201.724313] LustreError: 21231:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2201.732592] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 2201.741982] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2201.761576] LustreError: 8718:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2201.774556] LustreError: 8718:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 15 previous similar messages [ 2201.804220] Lustre: server umount lustre-MDT0001 complete [ 2207.430700] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2207.432865] in_atomic(): 1, irqs_disabled(): 0, pid: 21828, name: mount.lustre [ 2207.438934] CPU: 1 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2207.444381] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2207.449215] Call Trace: [ 2207.456568] [] dump_stack+0x19/0x1b [ 2207.458183] [] __might_sleep+0xd9/0x100 [ 2207.461386] [] kmem_cache_alloc+0x4f/0x2e0 [ 2207.466071] [] alloc_vfsmnt+0x24/0x240 [ 2207.468833] [] vfs_kern_mount+0x36/0x110 [ 2207.474009] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2207.477496] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2207.484009] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2207.489624] [] obd_setup+0x167/0x540 [obdclass] [ 2207.492632] [] class_setup+0x54f/0x830 [obdclass] [ 2207.498362] [] class_process_config+0x149b/0x2660 [obdclass] [ 2207.502221] [] ? __kmalloc+0x1e0/0x340 [ 2207.505029] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2207.509150] [] do_lcfg+0x263/0x520 [obdclass] [ 2207.513314] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2207.517302] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2207.521648] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2207.532979] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2207.536584] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2207.539964] [] mount_nodev+0x4d/0xb0 [ 2207.542945] [] lustre_mount+0x18/0x20 [lustre] [ 2207.546614] [] mount_fs+0x39/0x1b0 [ 2207.549648] [] vfs_kern_mount+0x67/0x110 [ 2207.552963] [] do_mount+0x1ef/0xce0 [ 2207.554785] [] ? copy_mount_options+0x39/0x1b0 [ 2207.556282] [] SyS_mount+0x83/0xd0 [ 2207.557703] [] system_call_fastpath+0x1f/0x24 [ 2207.560779] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2207.564646] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2207.606007] CPU: 1 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2207.616630] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2207.621344] Call Trace: [ 2207.624055] [] dump_stack+0x19/0x1b [ 2207.626103] [] __schedule_bug+0x64/0x72 [ 2207.632923] [] __schedule+0x791/0x7d0 [ 2207.640567] [] ? alloc_vfsmnt+0x24/0x240 [ 2207.643408] [] __cond_resched+0x26/0x30 [ 2207.645641] [] _cond_resched+0x3a/0x50 [ 2207.649529] [] kmem_cache_alloc+0x54/0x2e0 [ 2207.652356] [] alloc_vfsmnt+0x24/0x240 [ 2207.660895] [] vfs_kern_mount+0x36/0x110 [ 2207.663002] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2207.664546] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2207.667002] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2207.670123] [] obd_setup+0x167/0x540 [obdclass] [ 2207.672307] [] class_setup+0x54f/0x830 [obdclass] [ 2207.674420] [] class_process_config+0x149b/0x2660 [obdclass] [ 2207.676200] [] ? __kmalloc+0x1e0/0x340 [ 2207.678789] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2207.680711] [] do_lcfg+0x263/0x520 [obdclass] [ 2207.685930] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2207.691452] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2207.696577] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2207.701193] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2207.707648] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2207.713540] [] mount_nodev+0x4d/0xb0 [ 2207.718218] [] lustre_mount+0x18/0x20 [lustre] [ 2207.723475] [] mount_fs+0x39/0x1b0 [ 2207.726517] [] vfs_kern_mount+0x67/0x110 [ 2207.730063] [] do_mount+0x1ef/0xce0 [ 2207.733408] [] ? copy_mount_options+0x39/0x1b0 [ 2207.739660] [] SyS_mount+0x83/0xd0 [ 2207.743499] [] system_call_fastpath+0x1f/0x24 [ 2207.757938] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2207.761345] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2207.781150] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2207.788859] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2207.793537] Call Trace: [ 2207.794619] [] dump_stack+0x19/0x1b [ 2207.800137] [] __schedule_bug+0x64/0x72 [ 2207.803183] [] __schedule+0x791/0x7d0 [ 2207.806145] [] __cond_resched+0x26/0x30 [ 2207.808265] [] _cond_resched+0x3a/0x50 [ 2207.810787] [] __getblk+0x40/0x300 [ 2207.818781] [] ? _submit_bh+0x144/0x160 [ 2207.822061] [] __breadahead+0x21/0x70 [ 2207.825391] [] __ldiskfs_get_inode_loc+0x3ba/0x400 [ldiskfs] [ 2207.831702] [] ldiskfs_iget+0x96/0xc60 [ldiskfs] [ 2207.836988] [] ldiskfs_load_journal+0x19e/0x71c [ldiskfs] [ 2207.845401] [] ? do_raw_spin_unlock+0x49/0x90 [ 2207.850021] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2207.853085] [] mount_bdev+0x1b0/0x1f0 [ 2207.860056] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2207.868883] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2207.879264] [] mount_fs+0x39/0x1b0 [ 2207.886066] [] vfs_kern_mount+0x67/0x110 [ 2207.891984] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2207.896939] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2207.904591] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2207.917304] [] obd_setup+0x167/0x540 [obdclass] [ 2207.919632] [] class_setup+0x54f/0x830 [obdclass] [ 2207.934557] [] class_process_config+0x149b/0x2660 [obdclass] [ 2207.941707] [] ? __kmalloc+0x1e0/0x340 [ 2207.945600] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2207.949369] [] do_lcfg+0x263/0x520 [obdclass] [ 2207.954328] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2207.958888] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2207.962506] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2207.966759] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2207.970178] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2207.976787] [] mount_nodev+0x4d/0xb0 [ 2207.981714] [] lustre_mount+0x18/0x20 [lustre] [ 2207.988685] [] mount_fs+0x39/0x1b0 [ 2207.994395] [] vfs_kern_mount+0x67/0x110 [ 2207.998220] [] do_mount+0x1ef/0xce0 [ 2208.001906] [] ? copy_mount_options+0x39/0x1b0 [ 2208.007085] [] SyS_mount+0x83/0xd0 [ 2208.008831] [] system_call_fastpath+0x1f/0x24 [ 2208.014965] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2208.020825] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2208.061667] CPU: 1 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2208.066042] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2208.071671] Call Trace: [ 2208.072579] [] dump_stack+0x19/0x1b [ 2208.076816] [] __schedule_bug+0x64/0x72 [ 2208.078785] [] __schedule+0x791/0x7d0 [ 2208.084114] [] ? bit_wait+0x50/0x50 [ 2208.086221] [] schedule+0x29/0x70 [ 2208.092138] [] schedule_timeout+0x209/0x290 [ 2208.097657] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 2208.102098] [] ? kvm_clock_read+0x33/0x40 [ 2208.104425] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2208.106586] [] ? bit_wait+0x50/0x50 [ 2208.108640] [] io_schedule_timeout+0xad/0x130 [ 2208.110755] [] io_schedule+0x18/0x20 [ 2208.113349] [] bit_wait_io+0x11/0x50 [ 2208.115499] [] __wait_on_bit+0x65/0x90 [ 2208.117408] [] ? bit_wait+0x50/0x50 [ 2208.121010] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2208.126992] [] ? wake_bit_function+0x40/0x40 [ 2208.133548] [] __wait_on_buffer+0x2a/0x30 [ 2208.140117] [] __ldiskfs_get_inode_loc+0x1bd/0x400 [ldiskfs] [ 2208.147921] [] ldiskfs_iget+0x96/0xc60 [ldiskfs] [ 2208.150784] [] ldiskfs_load_journal+0x19e/0x71c [ldiskfs] [ 2208.157351] [] ? do_raw_spin_unlock+0x49/0x90 [ 2208.162648] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2208.165733] [] mount_bdev+0x1b0/0x1f0 [ 2208.168381] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2208.171577] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2208.176373] [] mount_fs+0x39/0x1b0 [ 2208.180603] [] vfs_kern_mount+0x67/0x110 [ 2208.188231] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2208.191125] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2208.194575] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2208.200644] [] obd_setup+0x167/0x540 [obdclass] [ 2208.204205] [] class_setup+0x54f/0x830 [obdclass] [ 2208.207854] [] class_process_config+0x149b/0x2660 [obdclass] [ 2208.213361] [] ? __kmalloc+0x1e0/0x340 [ 2208.217295] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2208.219600] [] do_lcfg+0x263/0x520 [obdclass] [ 2208.227669] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2208.231928] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2208.234424] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2208.239575] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2208.242932] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2208.246964] [] mount_nodev+0x4d/0xb0 [ 2208.248446] [] lustre_mount+0x18/0x20 [lustre] [ 2208.249885] [] mount_fs+0x39/0x1b0 [ 2208.251376] [] vfs_kern_mount+0x67/0x110 [ 2208.254614] [] do_mount+0x1ef/0xce0 [ 2208.256109] [] ? copy_mount_options+0x39/0x1b0 [ 2208.257952] [] SyS_mount+0x83/0xd0 [ 2208.261258] [] system_call_fastpath+0x1f/0x24 [ 2208.263499] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2208.265121] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2208.294764] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2208.299250] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2208.315906] Call Trace: [ 2208.316874] [] dump_stack+0x19/0x1b [ 2208.322284] [] __schedule_bug+0x64/0x72 [ 2208.328934] [] __schedule+0x791/0x7d0 [ 2208.330796] [] ? bit_wait+0x50/0x50 [ 2208.338726] [] schedule+0x29/0x70 [ 2208.340472] [] schedule_timeout+0x209/0x290 [ 2208.344675] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 2208.348657] [] ? kvm_clock_read+0x33/0x40 [ 2208.357493] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2208.363041] [] ? bit_wait+0x50/0x50 [ 2208.368460] [] io_schedule_timeout+0xad/0x130 [ 2208.374955] [] io_schedule+0x18/0x20 [ 2208.376432] [] bit_wait_io+0x11/0x50 [ 2208.386612] [] __wait_on_bit+0x65/0x90 [ 2208.390932] [] ? bit_wait+0x50/0x50 [ 2208.399630] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2208.405666] [] ? wake_bit_function+0x40/0x40 [ 2208.410139] [] __wait_on_buffer+0x2a/0x30 [ 2208.412016] [] journal_get_superblock+0x2c8/0x3a0 [jbd2] [ 2208.420049] [] jbd2_journal_wipe+0x20/0xb0 [jbd2] [ 2208.424090] [] ldiskfs_load_journal+0x5c5/0x71c [ldiskfs] [ 2208.427476] [] ? do_raw_spin_unlock+0x49/0x90 [ 2208.431305] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2208.436803] [] mount_bdev+0x1b0/0x1f0 [ 2208.438638] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2208.440685] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2208.445111] [] mount_fs+0x39/0x1b0 [ 2208.447973] [] vfs_kern_mount+0x67/0x110 [ 2208.459022] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2208.467468] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2208.472471] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2208.480203] [] obd_setup+0x167/0x540 [obdclass] [ 2208.483120] [] class_setup+0x54f/0x830 [obdclass] [ 2208.488854] [] class_process_config+0x149b/0x2660 [obdclass] [ 2208.498203] [] ? __kmalloc+0x1e0/0x340 [ 2208.502906] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2208.505157] [] do_lcfg+0x263/0x520 [obdclass] [ 2208.509719] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2208.514098] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2208.518825] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2208.522367] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2208.529406] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2208.535012] [] mount_nodev+0x4d/0xb0 [ 2208.547155] [] lustre_mount+0x18/0x20 [lustre] [ 2208.553113] [] mount_fs+0x39/0x1b0 [ 2208.554332] [] vfs_kern_mount+0x67/0x110 [ 2208.555606] [] do_mount+0x1ef/0xce0 [ 2208.556754] [] ? copy_mount_options+0x39/0x1b0 [ 2208.558112] [] SyS_mount+0x83/0xd0 [ 2208.559265] [] system_call_fastpath+0x1f/0x24 [ 2208.560728] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2208.562350] in_atomic(): 1, irqs_disabled(): 0, pid: 21828, name: mount.lustre [ 2208.563973] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2208.566425] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2208.568370] Call Trace: [ 2208.568976] [] dump_stack+0x19/0x1b [ 2208.570119] [] __might_sleep+0xd9/0x100 [ 2208.573649] [] kmem_cache_alloc_trace+0x57/0x2e0 [ 2208.575968] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 2208.586929] [] ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 2208.588559] [] ? do_raw_spin_unlock+0x49/0x90 [ 2208.599353] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2208.601043] [] mount_bdev+0x1b0/0x1f0 [ 2208.613755] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2208.618262] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2208.631584] [] mount_fs+0x39/0x1b0 [ 2208.632794] [] vfs_kern_mount+0x67/0x110 [ 2208.638401] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2208.643882] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2208.651236] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2208.658341] [] obd_setup+0x167/0x540 [obdclass] [ 2208.663367] [] class_setup+0x54f/0x830 [obdclass] [ 2208.668757] [] class_process_config+0x149b/0x2660 [obdclass] [ 2208.674249] [] ? __kmalloc+0x1e0/0x340 [ 2208.675723] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2208.677339] [] do_lcfg+0x263/0x520 [obdclass] [ 2208.678931] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2208.680798] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2208.682890] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2208.684681] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2208.696273] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2208.716843] [] mount_nodev+0x4d/0xb0 [ 2208.720595] [] lustre_mount+0x18/0x20 [lustre] [ 2208.725306] [] mount_fs+0x39/0x1b0 [ 2208.729939] [] vfs_kern_mount+0x67/0x110 [ 2208.731873] [] do_mount+0x1ef/0xce0 [ 2208.733806] [] ? copy_mount_options+0x39/0x1b0 [ 2208.735939] [] SyS_mount+0x83/0xd0 [ 2208.737623] [] system_call_fastpath+0x1f/0x24 [ 2208.739759] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2208.747070] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2208.791938] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2208.799716] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2208.802416] Call Trace: [ 2208.803296] [] dump_stack+0x19/0x1b [ 2208.804764] [] __schedule_bug+0x64/0x72 [ 2208.806623] [] __schedule+0x791/0x7d0 [ 2208.807890] [] __cond_resched+0x26/0x30 [ 2208.809181] [] _cond_resched+0x3a/0x50 [ 2208.811899] [] kmem_cache_alloc_trace+0x5c/0x2e0 [ 2208.813457] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 2208.816384] [] ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 2208.819715] [] ? do_raw_spin_unlock+0x49/0x90 [ 2208.822912] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2208.827151] [] mount_bdev+0x1b0/0x1f0 [ 2208.829440] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2208.832948] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2208.841326] [] mount_fs+0x39/0x1b0 [ 2208.844022] [] vfs_kern_mount+0x67/0x110 [ 2208.849288] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2208.856215] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2208.863320] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2208.872667] [] obd_setup+0x167/0x540 [obdclass] [ 2208.875253] [] class_setup+0x54f/0x830 [obdclass] [ 2208.877645] [] class_process_config+0x149b/0x2660 [obdclass] [ 2208.884131] [] ? __kmalloc+0x1e0/0x340 [ 2208.886011] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2208.889161] [] do_lcfg+0x263/0x520 [obdclass] [ 2208.892143] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2208.896919] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2208.899368] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2208.903627] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2208.906029] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2208.908072] [] mount_nodev+0x4d/0xb0 [ 2208.910405] [] lustre_mount+0x18/0x20 [lustre] [ 2208.917767] [] mount_fs+0x39/0x1b0 [ 2208.932162] [] vfs_kern_mount+0x67/0x110 [ 2208.936077] [] do_mount+0x1ef/0xce0 [ 2208.938008] [] ? copy_mount_options+0x39/0x1b0 [ 2208.944418] [] SyS_mount+0x83/0xd0 [ 2208.948439] [] system_call_fastpath+0x1f/0x24 [ 2208.950633] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2208.960771] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2208.996976] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2209.007201] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2209.011702] Call Trace: [ 2209.013885] [] dump_stack+0x19/0x1b [ 2209.019031] [] __schedule_bug+0x64/0x72 [ 2209.025932] [] __schedule+0x791/0x7d0 [ 2209.030428] [] schedule+0x29/0x70 [ 2209.034586] [] schedule_timeout+0x209/0x290 [ 2209.038270] [] ? native_smp_send_reschedule+0x4c/0x70 [ 2209.040499] [] ? resched_curr+0xd8/0xf0 [ 2209.047288] [] ? check_preempt_curr+0x80/0xa0 [ 2209.051420] [] ? ttwu_do_wakeup+0x19/0xf0 [ 2209.053337] [] wait_for_completion+0xfc/0x140 [ 2209.064186] [] ? wake_up_state+0x20/0x20 [ 2209.069002] [] kthread_create_on_node+0xa8/0x140 [ 2209.071707] [] ? commit_timeout+0x10/0x10 [jbd2] [ 2209.074378] [] jbd2_journal_load+0x16b/0x2d0 [jbd2] [ 2209.078127] [] ? ldiskfs_load_journal+0x5a9/0x71c [ldiskfs] [ 2209.084508] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 2209.089773] [] ? do_raw_spin_unlock+0x49/0x90 [ 2209.091639] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2209.093715] [] mount_bdev+0x1b0/0x1f0 [ 2209.095526] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2209.098104] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2209.107409] [] mount_fs+0x39/0x1b0 [ 2209.112295] [] vfs_kern_mount+0x67/0x110 [ 2209.116532] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2209.118670] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2209.121630] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2209.126234] [] obd_setup+0x167/0x540 [obdclass] [ 2209.128551] [] class_setup+0x54f/0x830 [obdclass] [ 2209.130157] [] class_process_config+0x149b/0x2660 [obdclass] [ 2209.134855] [] ? __kmalloc+0x1e0/0x340 [ 2209.138692] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2209.143551] [] do_lcfg+0x263/0x520 [obdclass] [ 2209.146627] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2209.152885] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2209.158665] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2209.161107] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2209.162951] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2209.169837] [] mount_nodev+0x4d/0xb0 [ 2209.173369] [] lustre_mount+0x18/0x20 [lustre] [ 2209.178237] [] mount_fs+0x39/0x1b0 [ 2209.181932] [] vfs_kern_mount+0x67/0x110 [ 2209.184803] [] do_mount+0x1ef/0xce0 [ 2209.189043] [] ? copy_mount_options+0x39/0x1b0 [ 2209.191427] [] SyS_mount+0x83/0xd0 [ 2209.194891] [] system_call_fastpath+0x1f/0x24 [ 2209.196958] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2209.199159] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2209.223153] CPU: 1 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2209.227277] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2209.233007] Call Trace: [ 2209.233917] [] dump_stack+0x19/0x1b [ 2209.235539] [] __schedule_bug+0x64/0x72 [ 2209.237341] [] __schedule+0x791/0x7d0 [ 2209.239187] [] schedule+0x29/0x70 [ 2209.240801] [] jbd2_journal_load+0x215/0x2d0 [jbd2] [ 2209.245948] [] ? wake_up_atomic_t+0x30/0x30 [ 2209.249937] [] ldiskfs_load_journal+0x61f/0x71c [ldiskfs] [ 2209.255140] [] ? do_raw_spin_unlock+0x49/0x90 [ 2209.259052] [] ldiskfs_fill_super+0x1e46/0x3060 [ldiskfs] [ 2209.264433] [] mount_bdev+0x1b0/0x1f0 [ 2209.267534] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2209.273612] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2209.275958] [] mount_fs+0x39/0x1b0 [ 2209.277691] [] vfs_kern_mount+0x67/0x110 [ 2209.281857] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2209.285682] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2209.288761] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2209.292501] [] obd_setup+0x167/0x540 [obdclass] [ 2209.296642] [] class_setup+0x54f/0x830 [obdclass] [ 2209.299527] [] class_process_config+0x149b/0x2660 [obdclass] [ 2209.302199] [] ? __kmalloc+0x1e0/0x340 [ 2209.303502] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2209.305445] [] do_lcfg+0x263/0x520 [obdclass] [ 2209.309748] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2209.315339] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2209.320155] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2209.323467] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2209.329997] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2209.333328] [] mount_nodev+0x4d/0xb0 [ 2209.337220] [] lustre_mount+0x18/0x20 [lustre] [ 2209.340381] [] mount_fs+0x39/0x1b0 [ 2209.346116] [] vfs_kern_mount+0x67/0x110 [ 2209.351094] [] do_mount+0x1ef/0xce0 [ 2209.354210] [] ? copy_mount_options+0x39/0x1b0 [ 2209.357716] [] SyS_mount+0x83/0xd0 [ 2209.359858] [] system_call_fastpath+0x1f/0x24 [ 2209.363850] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2209.366414] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2209.395896] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2209.400208] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2209.405048] Call Trace: [ 2209.406053] [] dump_stack+0x19/0x1b [ 2209.407822] [] __schedule_bug+0x64/0x72 [ 2209.409805] [] __schedule+0x791/0x7d0 [ 2209.411595] [] schedule+0x29/0x70 [ 2209.413310] [] schedule_timeout+0x209/0x290 [ 2209.415055] [] ? native_smp_send_reschedule+0x4c/0x70 [ 2209.416661] [] ? resched_curr+0xd8/0xf0 [ 2209.420210] [] ? check_preempt_curr+0x80/0xa0 [ 2209.423267] [] ? ttwu_do_wakeup+0x19/0xf0 [ 2209.431195] [] wait_for_completion+0xfc/0x140 [ 2209.433478] [] ? wake_up_state+0x20/0x20 [ 2209.435550] [] kthread_create_on_node+0xa8/0x140 [ 2209.440555] [] ? process_one_work+0x4a0/0x4a0 [ 2209.443571] [] __alloc_workqueue_key+0x336/0x480 [ 2209.447054] [] ? do_raw_spin_unlock+0x49/0x90 [ 2209.451400] [] ldiskfs_fill_super+0x2271/0x3060 [ldiskfs] [ 2209.455642] [] mount_bdev+0x1b0/0x1f0 [ 2209.464209] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2209.467943] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2209.470818] [] mount_fs+0x39/0x1b0 [ 2209.477558] [] vfs_kern_mount+0x67/0x110 [ 2209.479995] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2209.484011] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2209.487293] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2209.490674] [] obd_setup+0x167/0x540 [obdclass] [ 2209.495916] [] class_setup+0x54f/0x830 [obdclass] [ 2209.498936] [] class_process_config+0x149b/0x2660 [obdclass] [ 2209.503124] [] ? __kmalloc+0x1e0/0x340 [ 2209.505534] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2209.508627] [] do_lcfg+0x263/0x520 [obdclass] [ 2209.512665] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2209.515757] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2209.519476] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2209.525884] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2209.530209] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2209.534024] [] mount_nodev+0x4d/0xb0 [ 2209.536330] [] lustre_mount+0x18/0x20 [lustre] [ 2209.540066] [] mount_fs+0x39/0x1b0 [ 2209.542244] [] vfs_kern_mount+0x67/0x110 [ 2209.545283] [] do_mount+0x1ef/0xce0 [ 2209.548819] [] ? copy_mount_options+0x39/0x1b0 [ 2209.551228] [] SyS_mount+0x83/0xd0 [ 2209.552995] [] system_call_fastpath+0x1f/0x24 [ 2209.555767] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2209.557906] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2209.602239] CPU: 1 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2209.606101] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2209.610377] Call Trace: [ 2209.611179] [] dump_stack+0x19/0x1b [ 2209.612397] [] __schedule_bug+0x64/0x72 [ 2209.613752] [] __schedule+0x791/0x7d0 [ 2209.615468] [] ? ldiskfs_alloc_inode+0x1b/0x200 [ldiskfs] [ 2209.617366] [] __cond_resched+0x26/0x30 [ 2209.622149] [] _cond_resched+0x3a/0x50 [ 2209.627425] [] kmem_cache_alloc+0x54/0x2e0 [ 2209.630032] [] ldiskfs_alloc_inode+0x1b/0x200 [ldiskfs] [ 2209.637655] [] alloc_inode+0x1d/0xa0 [ 2209.640224] [] iget_locked+0xf8/0x1c0 [ 2209.641818] [] ldiskfs_iget+0x42/0xc60 [ldiskfs] [ 2209.647338] [] ldiskfs_fill_super+0x22a3/0x3060 [ldiskfs] [ 2209.659817] [] mount_bdev+0x1b0/0x1f0 [ 2209.664659] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2209.674632] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2209.677612] [] mount_fs+0x39/0x1b0 [ 2209.682999] [] vfs_kern_mount+0x67/0x110 [ 2209.686488] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2209.692843] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2209.696335] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2209.699900] [] obd_setup+0x167/0x540 [obdclass] [ 2209.701939] [] class_setup+0x54f/0x830 [obdclass] [ 2209.711090] [] class_process_config+0x149b/0x2660 [obdclass] [ 2209.713558] [] ? __kmalloc+0x1e0/0x340 [ 2209.715283] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2209.717605] [] do_lcfg+0x263/0x520 [obdclass] [ 2209.723085] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2209.729575] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2209.735402] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2209.742085] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2209.745425] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2209.750653] [] mount_nodev+0x4d/0xb0 [ 2209.751943] [] lustre_mount+0x18/0x20 [lustre] [ 2209.753386] [] mount_fs+0x39/0x1b0 [ 2209.754827] [] vfs_kern_mount+0x67/0x110 [ 2209.756329] [] do_mount+0x1ef/0xce0 [ 2209.758271] [] ? copy_mount_options+0x39/0x1b0 [ 2209.760547] [] SyS_mount+0x83/0xd0 [ 2209.762119] [] system_call_fastpath+0x1f/0x24 [ 2209.764372] BUG: sleeping function called from invalid context at fs/buffer.c:1352 [ 2209.766378] in_atomic(): 1, irqs_disabled(): 0, pid: 21828, name: mount.lustre [ 2209.768552] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2209.773352] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2209.776490] Call Trace: [ 2209.785384] [] dump_stack+0x19/0x1b [ 2209.787084] [] __might_sleep+0xd9/0x100 [ 2209.792139] [] __getblk+0x3b/0x300 [ 2209.798542] [] ? inode_init_always+0x13b/0x210 [ 2209.800751] [] __ldiskfs_get_inode_loc+0xe3/0x400 [ldiskfs] [ 2209.804427] [] ? do_raw_spin_unlock+0x49/0x90 [ 2209.808626] [] ldiskfs_iget+0x96/0xc60 [ldiskfs] [ 2209.810259] [] ldiskfs_fill_super+0x22a3/0x3060 [ldiskfs] [ 2209.813012] [] mount_bdev+0x1b0/0x1f0 [ 2209.815260] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2209.817779] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2209.820837] [] mount_fs+0x39/0x1b0 [ 2209.823316] [] vfs_kern_mount+0x67/0x110 [ 2209.825876] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2209.827850] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2209.830283] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2209.833012] [] obd_setup+0x167/0x540 [obdclass] [ 2209.836965] [] class_setup+0x54f/0x830 [obdclass] [ 2209.839699] [] class_process_config+0x149b/0x2660 [obdclass] [ 2209.844494] [] ? __kmalloc+0x1e0/0x340 [ 2209.847544] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2209.849466] [] do_lcfg+0x263/0x520 [obdclass] [ 2209.851584] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2209.854161] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2209.855698] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2209.857457] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2209.859805] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2209.861943] [] mount_nodev+0x4d/0xb0 [ 2209.863341] [] lustre_mount+0x18/0x20 [lustre] [ 2209.878278] [] mount_fs+0x39/0x1b0 [ 2209.880373] [] vfs_kern_mount+0x67/0x110 [ 2209.884349] [] do_mount+0x1ef/0xce0 [ 2209.885901] [] ? copy_mount_options+0x39/0x1b0 [ 2209.887778] [] SyS_mount+0x83/0xd0 [ 2209.889180] [] system_call_fastpath+0x1f/0x24 [ 2209.891336] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2209.894797] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2209.919634] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2209.923819] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2209.929348] Call Trace: [ 2209.932062] [] dump_stack+0x19/0x1b [ 2209.934304] [] __schedule_bug+0x64/0x72 [ 2209.937814] [] __schedule+0x791/0x7d0 [ 2209.941294] [] __cond_resched+0x26/0x30 [ 2209.945473] [] _cond_resched+0x3a/0x50 [ 2209.949299] [] __getblk+0x40/0x300 [ 2209.951179] [] ? inode_init_always+0x13b/0x210 [ 2209.964597] [] __ldiskfs_get_inode_loc+0xe3/0x400 [ldiskfs] [ 2209.975797] [] ? do_raw_spin_unlock+0x49/0x90 [ 2209.978011] [] ldiskfs_iget+0x96/0xc60 [ldiskfs] [ 2209.980373] [] ldiskfs_fill_super+0x22a3/0x3060 [ldiskfs] [ 2209.991721] [] mount_bdev+0x1b0/0x1f0 [ 2209.997208] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2210.015406] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2210.022081] [] mount_fs+0x39/0x1b0 [ 2210.024932] [] vfs_kern_mount+0x67/0x110 [ 2210.028593] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2210.030747] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2210.033785] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2210.036284] [] obd_setup+0x167/0x540 [obdclass] [ 2210.038161] [] class_setup+0x54f/0x830 [obdclass] [ 2210.040338] [] class_process_config+0x149b/0x2660 [obdclass] [ 2210.042765] [] ? __kmalloc+0x1e0/0x340 [ 2210.044693] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2210.046744] [] do_lcfg+0x263/0x520 [obdclass] [ 2210.049467] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2210.053400] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2210.066563] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2210.069794] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2210.072769] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2210.075171] [] mount_nodev+0x4d/0xb0 [ 2210.078230] [] lustre_mount+0x18/0x20 [lustre] [ 2210.083298] [] mount_fs+0x39/0x1b0 [ 2210.092005] [] vfs_kern_mount+0x67/0x110 [ 2210.093810] [] do_mount+0x1ef/0xce0 [ 2210.102026] [] ? copy_mount_options+0x39/0x1b0 [ 2210.105485] [] SyS_mount+0x83/0xd0 [ 2210.108621] [] system_call_fastpath+0x1f/0x24 [ 2210.110895] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2210.113272] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2210.200682] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2210.210911] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2210.223634] Call Trace: [ 2210.224566] [] dump_stack+0x19/0x1b [ 2210.228198] [] __schedule_bug+0x64/0x72 [ 2210.241570] [] __schedule+0x791/0x7d0 [ 2210.249491] [] ? bit_wait+0x50/0x50 [ 2210.257014] [] schedule+0x29/0x70 [ 2210.258738] [] schedule_timeout+0x209/0x290 [ 2210.264478] [] ? blk_mq_try_issue_directly+0x60/0xd0 [ 2210.267759] [] ? kvm_clock_read+0x33/0x40 [ 2210.269204] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2210.272101] [] ? ktime_get_ts64+0x4c/0xf0 [ 2210.276285] [] ? bit_wait+0x50/0x50 [ 2210.278572] [] io_schedule_timeout+0xad/0x130 [ 2210.280399] [] io_schedule+0x18/0x20 [ 2210.285504] [] bit_wait_io+0x11/0x50 [ 2210.287262] [] __wait_on_bit+0x65/0x90 [ 2210.289275] [] ? bit_wait+0x50/0x50 [ 2210.292890] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2210.296287] [] ? wake_bit_function+0x40/0x40 [ 2210.298694] [] __sync_dirty_buffer+0xe8/0x110 [ 2210.301238] [] sync_dirty_buffer+0x13/0x20 [ 2210.308173] [] ldiskfs_commit_super+0x1e0/0x280 [ldiskfs] [ 2210.313902] [] ldiskfs_setup_super+0x120/0x190 [ldiskfs] [ 2210.316361] [] ldiskfs_fill_super+0x2429/0x3060 [ldiskfs] [ 2210.318890] [] mount_bdev+0x1b0/0x1f0 [ 2210.320344] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2210.350500] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2210.358373] [] mount_fs+0x39/0x1b0 [ 2210.366293] [] vfs_kern_mount+0x67/0x110 [ 2210.370602] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2210.375647] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2210.386757] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2210.393216] [] obd_setup+0x167/0x540 [obdclass] [ 2210.402241] [] class_setup+0x54f/0x830 [obdclass] [ 2210.406918] [] class_process_config+0x149b/0x2660 [obdclass] [ 2210.413283] [] ? __kmalloc+0x1e0/0x340 [ 2210.416434] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2210.422718] [] do_lcfg+0x263/0x520 [obdclass] [ 2210.424296] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2210.425959] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2210.427826] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2210.429908] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2210.432102] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2210.433944] [] mount_nodev+0x4d/0xb0 [ 2210.438184] [] lustre_mount+0x18/0x20 [lustre] [ 2210.442028] [] mount_fs+0x39/0x1b0 [ 2210.452614] [] vfs_kern_mount+0x67/0x110 [ 2210.468591] [] do_mount+0x1ef/0xce0 [ 2210.481421] [] ? copy_mount_options+0x39/0x1b0 [ 2210.486942] [] SyS_mount+0x83/0xd0 [ 2210.488544] [] system_call_fastpath+0x1f/0x24 [ 2210.493057] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2210.498924] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2210.534381] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2210.539634] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2210.550832] Call Trace: [ 2210.551969] [] dump_stack+0x19/0x1b [ 2210.556388] [] __schedule_bug+0x64/0x72 [ 2210.563706] [] __schedule+0x791/0x7d0 [ 2210.569391] [] ? ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2210.573994] [] __cond_resched+0x26/0x30 [ 2210.577816] [] _cond_resched+0x3a/0x50 [ 2210.582261] [] kmem_cache_alloc+0x54/0x2e0 [ 2210.588604] [] ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2210.591626] [] ldiskfs_mb_init+0x53e/0x760 [ldiskfs] [ 2210.598336] [] ldiskfs_fill_super+0x2522/0x3060 [ldiskfs] [ 2210.605056] [] mount_bdev+0x1b0/0x1f0 [ 2210.614036] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2210.616386] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2210.626205] [] mount_fs+0x39/0x1b0 [ 2210.632039] [] vfs_kern_mount+0x67/0x110 [ 2210.634400] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2210.643905] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2210.652414] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2210.660222] [] obd_setup+0x167/0x540 [obdclass] [ 2210.666993] [] class_setup+0x54f/0x830 [obdclass] [ 2210.669829] [] class_process_config+0x149b/0x2660 [obdclass] [ 2210.683857] [] ? __kmalloc+0x1e0/0x340 [ 2210.687235] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2210.692903] [] do_lcfg+0x263/0x520 [obdclass] [ 2210.696123] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2210.699617] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2210.709039] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2210.715346] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2210.722303] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2210.731887] [] mount_nodev+0x4d/0xb0 [ 2210.739660] [] lustre_mount+0x18/0x20 [lustre] [ 2210.748374] [] mount_fs+0x39/0x1b0 [ 2210.751956] [] vfs_kern_mount+0x67/0x110 [ 2210.760520] [] do_mount+0x1ef/0xce0 [ 2210.762314] [] ? copy_mount_options+0x39/0x1b0 [ 2210.765324] [] SyS_mount+0x83/0xd0 [ 2210.767317] [] system_call_fastpath+0x1f/0x24 [ 2210.780418] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2210.784087] in_atomic(): 1, irqs_disabled(): 0, pid: 21828, name: mount.lustre [ 2210.791352] CPU: 1 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2210.796752] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2210.799756] Call Trace: [ 2210.800561] [] dump_stack+0x19/0x1b [ 2210.802010] [] __might_sleep+0xd9/0x100 [ 2210.807559] [] kmem_cache_alloc+0x4f/0x2e0 [ 2210.811462] [] ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2210.817003] [] ldiskfs_mb_init+0x53e/0x760 [ldiskfs] [ 2210.826644] [] ldiskfs_fill_super+0x2522/0x3060 [ldiskfs] [ 2210.829380] [] mount_bdev+0x1b0/0x1f0 [ 2210.832078] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2210.835652] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2210.837749] [] mount_fs+0x39/0x1b0 [ 2210.840130] [] vfs_kern_mount+0x67/0x110 [ 2210.842386] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2210.845144] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2210.853106] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2210.859140] [] obd_setup+0x167/0x540 [obdclass] [ 2210.862972] [] class_setup+0x54f/0x830 [obdclass] [ 2210.868753] [] class_process_config+0x149b/0x2660 [obdclass] [ 2210.872360] [] ? __kmalloc+0x1e0/0x340 [ 2210.879943] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2210.886512] [] do_lcfg+0x263/0x520 [obdclass] [ 2210.888987] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2210.897582] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2210.900684] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2210.904515] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2210.906938] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2210.909552] [] mount_nodev+0x4d/0xb0 [ 2210.912186] [] lustre_mount+0x18/0x20 [lustre] [ 2210.914288] [] mount_fs+0x39/0x1b0 [ 2210.916577] [] vfs_kern_mount+0x67/0x110 [ 2210.918239] [] do_mount+0x1ef/0xce0 [ 2210.924175] [] ? copy_mount_options+0x39/0x1b0 [ 2210.928959] [] SyS_mount+0x83/0xd0 [ 2210.932622] [] system_call_fastpath+0x1f/0x24 [ 2210.937092] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2210.940559] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2210.967007] CPU: 1 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2210.970174] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2210.976710] Call Trace: [ 2210.980064] [] dump_stack+0x19/0x1b [ 2210.984432] [] __schedule_bug+0x64/0x72 [ 2210.987936] [] __schedule+0x791/0x7d0 [ 2210.991964] [] ? ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2211.001156] [] __cond_resched+0x26/0x30 [ 2211.007914] [] _cond_resched+0x3a/0x50 [ 2211.016009] [] kmem_cache_alloc+0x54/0x2e0 [ 2211.019894] [] ldiskfs_mb_add_groupinfo+0xe1/0x260 [ldiskfs] [ 2211.024289] [] ldiskfs_mb_init+0x53e/0x760 [ldiskfs] [ 2211.029945] [] ldiskfs_fill_super+0x2522/0x3060 [ldiskfs] [ 2211.035551] [] mount_bdev+0x1b0/0x1f0 [ 2211.039503] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2211.043061] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2211.050367] [] mount_fs+0x39/0x1b0 [ 2211.056085] [] vfs_kern_mount+0x67/0x110 [ 2211.060395] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2211.064768] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2211.070129] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2211.074393] [] obd_setup+0x167/0x540 [obdclass] [ 2211.080620] [] class_setup+0x54f/0x830 [obdclass] [ 2211.084551] [] class_process_config+0x149b/0x2660 [obdclass] [ 2211.087367] [] ? __kmalloc+0x1e0/0x340 [ 2211.090090] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2211.100316] [] do_lcfg+0x263/0x520 [obdclass] [ 2211.114899] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2211.122014] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2211.124204] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2211.128217] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2211.130321] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2211.144341] [] mount_nodev+0x4d/0xb0 [ 2211.155893] [] lustre_mount+0x18/0x20 [lustre] [ 2211.159921] [] mount_fs+0x39/0x1b0 [ 2211.168168] [] vfs_kern_mount+0x67/0x110 [ 2211.174670] [] do_mount+0x1ef/0xce0 [ 2211.177630] [] ? copy_mount_options+0x39/0x1b0 [ 2211.181647] [] SyS_mount+0x83/0xd0 [ 2211.190669] [] system_call_fastpath+0x1f/0x24 [ 2211.195670] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2211.202890] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2211.243366] CPU: 1 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2211.247614] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2211.251946] Call Trace: [ 2211.255678] [] dump_stack+0x19/0x1b [ 2211.258678] [] __schedule_bug+0x64/0x72 [ 2211.263107] [] __schedule+0x791/0x7d0 [ 2211.273448] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2211.277615] [] ? bit_wait+0x50/0x50 [ 2211.281285] [] schedule+0x29/0x70 [ 2211.287587] [] schedule_timeout+0x209/0x290 [ 2211.290384] [] ? kvm_clock_read+0x33/0x40 [ 2211.300588] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2211.302201] [] ? ktime_get_ts64+0x4c/0xf0 [ 2211.315560] [] ? bit_wait+0x50/0x50 [ 2211.328338] [] io_schedule_timeout+0xad/0x130 [ 2211.330591] [] io_schedule+0x18/0x20 [ 2211.332508] [] bit_wait_io+0x11/0x50 [ 2211.342560] [] __wait_on_bit+0x65/0x90 [ 2211.344369] [] ? bit_wait+0x50/0x50 [ 2211.350083] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2211.362290] [] ? wake_bit_function+0x40/0x40 [ 2211.368384] [] __wait_on_buffer+0x2a/0x30 [ 2211.379075] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2211.383452] [] ? mark_page_accessed+0xd8/0xe0 [ 2211.391038] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2211.397620] [] v2_read_header+0x1f/0x50 [ 2211.399576] [] v2_check_quota_file+0x2b/0x70 [ 2211.401755] [] ? igrab+0x36/0x60 [ 2211.403616] [] vfs_load_quota_inode+0x279/0x570 [ 2211.427656] [] ? unlock_new_inode+0x55/0x80 [ 2211.436376] [] dquot_enable+0xf0/0x110 [ 2211.445592] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 2211.457435] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 2211.471779] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 2211.481442] [] mount_bdev+0x1b0/0x1f0 [ 2211.493003] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2211.502552] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2211.509902] [] mount_fs+0x39/0x1b0 [ 2211.514295] [] vfs_kern_mount+0x67/0x110 [ 2211.516173] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2211.518525] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2211.537972] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2211.546332] [] obd_setup+0x167/0x540 [obdclass] [ 2211.552746] [] class_setup+0x54f/0x830 [obdclass] [ 2211.560116] [] class_process_config+0x149b/0x2660 [obdclass] [ 2211.564978] [] ? __kmalloc+0x1e0/0x340 [ 2211.574092] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2211.579022] [] do_lcfg+0x263/0x520 [obdclass] [ 2211.590563] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2211.602341] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2211.606896] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2211.612306] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2211.620277] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2211.623495] [] mount_nodev+0x4d/0xb0 [ 2211.630122] [] lustre_mount+0x18/0x20 [lustre] [ 2211.638886] [] mount_fs+0x39/0x1b0 [ 2211.642740] [] vfs_kern_mount+0x67/0x110 [ 2211.647639] [] do_mount+0x1ef/0xce0 [ 2211.655295] [] ? copy_mount_options+0x39/0x1b0 [ 2211.659156] [] SyS_mount+0x83/0xd0 [ 2211.660625] [] system_call_fastpath+0x1f/0x24 [ 2211.662363] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2211.667404] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2211.720086] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2211.724782] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2211.729859] Call Trace: [ 2211.730684] [] dump_stack+0x19/0x1b [ 2211.734759] [] __schedule_bug+0x64/0x72 [ 2211.738168] [] __schedule+0x791/0x7d0 [ 2211.743386] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2211.747639] [] ? bit_wait+0x50/0x50 [ 2211.750390] [] schedule+0x29/0x70 [ 2211.752266] [] schedule_timeout+0x209/0x290 [ 2211.756335] [] ? kvm_clock_read+0x33/0x40 [ 2211.758159] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2211.760689] [] ? ktime_get_ts64+0x4c/0xf0 [ 2211.764716] [] ? bit_wait+0x50/0x50 [ 2211.766438] [] io_schedule_timeout+0xad/0x130 [ 2211.771527] [] io_schedule+0x18/0x20 [ 2211.775011] [] bit_wait_io+0x11/0x50 [ 2211.778287] [] __wait_on_bit+0x65/0x90 [ 2211.783464] [] ? bit_wait+0x50/0x50 [ 2211.787924] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2211.790870] [] ? wake_bit_function+0x40/0x40 [ 2211.793052] [] __wait_on_buffer+0x2a/0x30 [ 2211.795218] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2211.797540] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2211.799829] [] v2_read_header+0x1f/0x50 [ 2211.801714] [] v2_check_quota_file+0x2b/0x70 [ 2211.809716] [] ? igrab+0x36/0x60 [ 2211.817052] [] vfs_load_quota_inode+0x279/0x570 [ 2211.829325] [] ? unlock_new_inode+0x55/0x80 [ 2211.837188] [] dquot_enable+0xf0/0x110 [ 2211.843517] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 2211.852759] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 2211.856185] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 2211.859704] [] mount_bdev+0x1b0/0x1f0 [ 2211.864391] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2211.873292] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2211.884179] [] mount_fs+0x39/0x1b0 [ 2211.886192] [] vfs_kern_mount+0x67/0x110 [ 2211.891885] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2211.898411] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2211.911352] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2211.915019] [] obd_setup+0x167/0x540 [obdclass] [ 2211.916931] [] class_setup+0x54f/0x830 [obdclass] [ 2211.918814] [] class_process_config+0x149b/0x2660 [obdclass] [ 2211.923123] [] ? __kmalloc+0x1e0/0x340 [ 2211.926774] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2211.929504] [] do_lcfg+0x263/0x520 [obdclass] [ 2211.933164] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2211.936164] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2211.938080] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2211.942206] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2211.944571] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2211.948260] [] mount_nodev+0x4d/0xb0 [ 2211.951383] [] lustre_mount+0x18/0x20 [lustre] [ 2211.955853] [] mount_fs+0x39/0x1b0 [ 2211.962875] [] vfs_kern_mount+0x67/0x110 [ 2211.973929] [] do_mount+0x1ef/0xce0 [ 2211.980438] [] ? copy_mount_options+0x39/0x1b0 [ 2211.990336] [] SyS_mount+0x83/0xd0 [ 2211.996499] [] system_call_fastpath+0x1f/0x24 [ 2212.002154] BUG: sleeping function called from invalid context at kernel/mutex.c:104 [ 2212.005950] in_atomic(): 1, irqs_disabled(): 0, pid: 21828, name: mount.lustre [ 2212.014137] CPU: 2 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2212.019502] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2212.026395] Call Trace: [ 2212.027207] [] dump_stack+0x19/0x1b [ 2212.036996] [] __might_sleep+0xd9/0x100 [ 2212.039206] [] mutex_lock+0x20/0x40 [ 2212.041117] [] vfs_load_quota_inode+0x2d8/0x570 [ 2212.044297] [] dquot_enable+0xf0/0x110 [ 2212.047299] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 2212.050014] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 2212.054058] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 2212.063909] [] mount_bdev+0x1b0/0x1f0 [ 2212.065666] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2212.071913] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2212.076647] [] mount_fs+0x39/0x1b0 [ 2212.079499] [] vfs_kern_mount+0x67/0x110 [ 2212.083286] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2212.091487] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2212.098735] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2212.104209] [] obd_setup+0x167/0x540 [obdclass] [ 2212.117790] [] class_setup+0x54f/0x830 [obdclass] [ 2212.123529] [] class_process_config+0x149b/0x2660 [obdclass] [ 2212.127711] [] ? __kmalloc+0x1e0/0x340 [ 2212.134976] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2212.142962] [] do_lcfg+0x263/0x520 [obdclass] [ 2212.145222] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2212.149976] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2212.155647] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2212.158956] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2212.163126] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2212.165696] [] mount_nodev+0x4d/0xb0 [ 2212.167577] [] lustre_mount+0x18/0x20 [lustre] [ 2212.169315] [] mount_fs+0x39/0x1b0 [ 2212.171178] [] vfs_kern_mount+0x67/0x110 [ 2212.175330] [] do_mount+0x1ef/0xce0 [ 2212.185948] [] ? copy_mount_options+0x39/0x1b0 [ 2212.191533] [] SyS_mount+0x83/0xd0 [ 2212.193638] [] system_call_fastpath+0x1f/0x24 [ 2212.196535] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2212.200843] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2212.252859] CPU: 2 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2212.264006] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2212.273533] Call Trace: [ 2212.278330] [] dump_stack+0x19/0x1b [ 2212.290005] [] __schedule_bug+0x64/0x72 [ 2212.297604] [] __schedule+0x791/0x7d0 [ 2212.301966] [] __cond_resched+0x26/0x30 [ 2212.307862] [] _cond_resched+0x3a/0x50 [ 2212.316208] [] mutex_lock+0x25/0x40 [ 2212.320674] [] vfs_load_quota_inode+0x2d8/0x570 [ 2212.325547] [] dquot_enable+0xf0/0x110 [ 2212.329843] [] ldiskfs_quota_enable+0xa1/0x100 [ldiskfs] [ 2212.334105] [] ldiskfs_enable_quotas+0xd5/0x130 [ldiskfs] [ 2212.338891] [] ldiskfs_fill_super+0x3038/0x3060 [ldiskfs] [ 2212.341879] [] mount_bdev+0x1b0/0x1f0 [ 2212.343454] [] ? ldiskfs_calculate_overhead+0x440/0x440 [ldiskfs] [ 2212.351195] [] ldiskfs_mount+0x15/0x20 [ldiskfs] [ 2212.356398] [] mount_fs+0x39/0x1b0 [ 2212.360389] [] vfs_kern_mount+0x67/0x110 [ 2212.366411] [] osd_mount+0x538/0xe50 [osd_ldiskfs] [ 2212.369569] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2212.375045] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2212.383796] [] obd_setup+0x167/0x540 [obdclass] [ 2212.387372] [] class_setup+0x54f/0x830 [obdclass] [ 2212.395340] [] class_process_config+0x149b/0x2660 [obdclass] [ 2212.401145] [] ? __kmalloc+0x1e0/0x340 [ 2212.405251] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2212.409350] [] do_lcfg+0x263/0x520 [obdclass] [ 2212.412020] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2212.417331] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2212.421829] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2212.424965] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2212.429480] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2212.432564] [] mount_nodev+0x4d/0xb0 [ 2212.437297] [] lustre_mount+0x18/0x20 [lustre] [ 2212.439629] [] mount_fs+0x39/0x1b0 [ 2212.444975] [] vfs_kern_mount+0x67/0x110 [ 2212.449642] [] do_mount+0x1ef/0xce0 [ 2212.453315] [] ? copy_mount_options+0x39/0x1b0 [ 2212.459790] [] SyS_mount+0x83/0xd0 [ 2212.464030] [] system_call_fastpath+0x1f/0x24 [ 2212.474622] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2212.488150] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2212.493509] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2212.528477] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2212.532818] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2212.538598] Call Trace: [ 2212.542111] [] dump_stack+0x19/0x1b [ 2212.544968] [] __schedule_bug+0x64/0x72 [ 2212.549161] [] __schedule+0x791/0x7d0 [ 2212.551823] [] ? dquot_alloc+0x1a/0x20 [ 2212.553912] [] __cond_resched+0x26/0x30 [ 2212.555931] [] _cond_resched+0x3a/0x50 [ 2212.557846] [] kmem_cache_alloc+0x54/0x2e0 [ 2212.559960] [] ? cfs_trace_unlock_tcd+0x27/0x70 [libcfs] [ 2212.562561] [] ? libcfs_debug_msg+0x4c9/0xc60 [libcfs] [ 2212.564962] [] dquot_alloc+0x1a/0x20 [ 2212.566875] [] dqget+0x242/0x460 [ 2212.568639] [] __dquot_initialize+0x12d/0x230 [ 2212.570789] [] ? free_pages.part.76+0x40/0x50 [ 2212.576198] [] dquot_initialize+0x13/0x20 [ 2212.582995] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2212.587606] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2212.592580] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2212.599492] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2212.604040] [] obd_setup+0x167/0x540 [obdclass] [ 2212.608615] [] class_setup+0x54f/0x830 [obdclass] [ 2212.618118] [] class_process_config+0x149b/0x2660 [obdclass] [ 2212.620265] [] ? __kmalloc+0x1e0/0x340 [ 2212.622976] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2212.624975] [] do_lcfg+0x263/0x520 [obdclass] [ 2212.626958] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2212.639292] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2212.641341] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2212.644816] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2212.646876] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2212.664137] [] mount_nodev+0x4d/0xb0 [ 2212.669168] [] lustre_mount+0x18/0x20 [lustre] [ 2212.676426] [] mount_fs+0x39/0x1b0 [ 2212.681189] [] vfs_kern_mount+0x67/0x110 [ 2212.692180] [] do_mount+0x1ef/0xce0 [ 2212.695639] [] ? copy_mount_options+0x39/0x1b0 [ 2212.700845] [] SyS_mount+0x83/0xd0 [ 2212.702458] [] system_call_fastpath+0x1f/0x24 [ 2212.706055] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2212.709084] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2212.819965] CPU: 1 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2212.834323] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2212.842756] Call Trace: [ 2212.843620] [] dump_stack+0x19/0x1b [ 2212.850762] [] __schedule_bug+0x64/0x72 [ 2212.854711] [] __schedule+0x791/0x7d0 [ 2212.856104] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2212.860756] [] ? bit_wait+0x50/0x50 [ 2212.863490] [] schedule+0x29/0x70 [ 2212.864680] [] schedule_timeout+0x209/0x290 [ 2212.866063] [] ? kvm_clock_read+0x33/0x40 [ 2212.871822] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2212.874360] [] ? ktime_get_ts64+0x4c/0xf0 [ 2212.875736] [] ? bit_wait+0x50/0x50 [ 2212.876956] [] io_schedule_timeout+0xad/0x130 [ 2212.878328] [] io_schedule+0x18/0x20 [ 2212.879504] [] bit_wait_io+0x11/0x50 [ 2212.880750] [] __wait_on_bit+0x65/0x90 [ 2212.884195] [] ? bit_wait+0x50/0x50 [ 2212.887004] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2212.893781] [] ? wake_bit_function+0x40/0x40 [ 2212.900011] [] __wait_on_buffer+0x2a/0x30 [ 2212.907175] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2212.913991] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2212.922390] [] read_blk+0x4c/0x60 [ 2212.924411] [] find_tree_dqentry+0x47/0x240 [ 2212.926454] [] find_tree_dqentry+0x1aa/0x240 [ 2212.928436] [] find_tree_dqentry+0x1aa/0x240 [ 2212.929947] [] find_tree_dqentry+0x1aa/0x240 [ 2212.932053] [] qtree_read_dquot+0x14c/0x380 [ 2212.934157] [] v2_read_dquot+0x2b/0x30 [ 2212.935891] [] dquot_acquire+0xe4/0x130 [ 2212.937667] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2212.939999] [] dqget+0x3fb/0x460 [ 2212.942846] [] __dquot_initialize+0x12d/0x230 [ 2212.945269] [] ? free_pages.part.76+0x40/0x50 [ 2212.948738] [] dquot_initialize+0x13/0x20 [ 2212.951637] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2212.953579] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2212.955514] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2212.958268] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2212.962939] [] obd_setup+0x167/0x540 [obdclass] [ 2212.969353] [] class_setup+0x54f/0x830 [obdclass] [ 2212.971705] [] class_process_config+0x149b/0x2660 [obdclass] [ 2212.978047] [] ? __kmalloc+0x1e0/0x340 [ 2212.983251] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2212.988282] [] do_lcfg+0x263/0x520 [obdclass] [ 2212.993100] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2212.995525] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2212.998338] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2213.001618] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2213.005128] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2213.008381] [] mount_nodev+0x4d/0xb0 [ 2213.012928] [] lustre_mount+0x18/0x20 [lustre] [ 2213.015850] [] mount_fs+0x39/0x1b0 [ 2213.017503] [] vfs_kern_mount+0x67/0x110 [ 2213.022372] [] do_mount+0x1ef/0xce0 [ 2213.026241] [] ? copy_mount_options+0x39/0x1b0 [ 2213.030020] [] SyS_mount+0x83/0xd0 [ 2213.033952] [] system_call_fastpath+0x1f/0x24 [ 2213.037211] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2213.044208] in_atomic(): 1, irqs_disabled(): 0, pid: 21828, name: mount.lustre [ 2213.050062] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2213.060610] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2213.070498] Call Trace: [ 2213.071439] [] dump_stack+0x19/0x1b [ 2213.073312] [] __might_sleep+0xd9/0x100 [ 2213.074834] [] __kmalloc+0x73/0x340 [ 2213.076488] [] ? getdqbuf+0x14/0x40 [ 2213.078303] [] getdqbuf+0x14/0x40 [ 2213.104359] [] find_tree_dqentry+0xaf/0x240 [ 2213.119404] [] find_tree_dqentry+0x1aa/0x240 [ 2213.131092] [] find_tree_dqentry+0x1aa/0x240 [ 2213.133265] [] find_tree_dqentry+0x1aa/0x240 [ 2213.150000] [] qtree_read_dquot+0x14c/0x380 [ 2213.151607] [] v2_read_dquot+0x2b/0x30 [ 2213.159368] [] dquot_acquire+0xe4/0x130 [ 2213.164085] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2213.174049] [] dqget+0x3fb/0x460 [ 2213.180399] [] __dquot_initialize+0x12d/0x230 [ 2213.191926] [] ? free_pages.part.76+0x40/0x50 [ 2213.197364] [] dquot_initialize+0x13/0x20 [ 2213.207716] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2213.215690] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2213.230200] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2213.232805] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2213.238199] [] obd_setup+0x167/0x540 [obdclass] [ 2213.240444] [] class_setup+0x54f/0x830 [obdclass] [ 2213.254231] [] class_process_config+0x149b/0x2660 [obdclass] [ 2213.262398] [] ? __kmalloc+0x1e0/0x340 [ 2213.270083] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2213.283964] [] do_lcfg+0x263/0x520 [obdclass] [ 2213.289174] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2213.291384] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2213.300994] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2213.308766] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2213.321572] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2213.327420] [] mount_nodev+0x4d/0xb0 [ 2213.333700] [] lustre_mount+0x18/0x20 [lustre] [ 2213.338627] [] mount_fs+0x39/0x1b0 [ 2213.345503] [] vfs_kern_mount+0x67/0x110 [ 2213.350916] [] do_mount+0x1ef/0xce0 [ 2213.355634] [] ? copy_mount_options+0x39/0x1b0 [ 2213.364508] [] SyS_mount+0x83/0xd0 [ 2213.371169] [] system_call_fastpath+0x1f/0x24 [ 2213.377942] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2213.385401] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2213.431445] CPU: 0 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2213.436361] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2213.439311] Call Trace: [ 2213.449418] [] dump_stack+0x19/0x1b [ 2213.452574] [] __schedule_bug+0x64/0x72 [ 2213.456928] [] __schedule+0x791/0x7d0 [ 2213.458218] [] __cond_resched+0x26/0x30 [ 2213.465289] [] _cond_resched+0x3a/0x50 [ 2213.472560] [] __kmalloc+0x78/0x340 [ 2213.479742] [] ? getdqbuf+0x14/0x40 [ 2213.482987] [] getdqbuf+0x14/0x40 [ 2213.487102] [] find_tree_dqentry+0xaf/0x240 [ 2213.493622] [] find_tree_dqentry+0x1aa/0x240 [ 2213.497869] [] find_tree_dqentry+0x1aa/0x240 [ 2213.504437] [] find_tree_dqentry+0x1aa/0x240 [ 2213.508686] [] qtree_read_dquot+0x14c/0x380 [ 2213.513988] [] v2_read_dquot+0x2b/0x30 [ 2213.518888] [] dquot_acquire+0xe4/0x130 [ 2213.523951] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2213.530987] [] dqget+0x3fb/0x460 [ 2213.535944] [] __dquot_initialize+0x12d/0x230 [ 2213.542410] [] ? free_pages.part.76+0x40/0x50 [ 2213.548623] [] dquot_initialize+0x13/0x20 [ 2213.560529] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2213.562104] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2213.567422] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2213.572868] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2213.579209] [] obd_setup+0x167/0x540 [obdclass] [ 2213.587166] [] class_setup+0x54f/0x830 [obdclass] [ 2213.594245] [] class_process_config+0x149b/0x2660 [obdclass] [ 2213.600981] [] ? __kmalloc+0x1e0/0x340 [ 2213.608010] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2213.611764] [] do_lcfg+0x263/0x520 [obdclass] [ 2213.616678] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2213.619199] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2213.621598] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2213.624086] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2213.639824] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2213.644151] [] mount_nodev+0x4d/0xb0 [ 2213.648173] [] lustre_mount+0x18/0x20 [lustre] [ 2213.653922] [] mount_fs+0x39/0x1b0 [ 2213.655129] [] vfs_kern_mount+0x67/0x110 [ 2213.661799] [] do_mount+0x1ef/0xce0 [ 2213.667360] [] ? copy_mount_options+0x39/0x1b0 [ 2213.671938] [] SyS_mount+0x83/0xd0 [ 2213.675948] [] system_call_fastpath+0x1f/0x24 [ 2213.681385] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2213.682930] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2213.744121] CPU: 1 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2213.758341] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2213.766078] Call Trace: [ 2213.768611] [] dump_stack+0x19/0x1b [ 2213.777262] [] __schedule_bug+0x64/0x72 [ 2213.779794] [] __schedule+0x791/0x7d0 [ 2213.791009] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2213.797403] [] ? bit_wait+0x50/0x50 [ 2213.799916] [] schedule+0x29/0x70 [ 2213.806596] [] schedule_timeout+0x209/0x290 [ 2213.815802] [] ? kvm_clock_read+0x33/0x40 [ 2213.825849] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2213.834015] [] ? ktime_get_ts64+0x4c/0xf0 [ 2213.840741] [] ? bit_wait+0x50/0x50 [ 2213.846933] [] io_schedule_timeout+0xad/0x130 [ 2213.853412] [] io_schedule+0x18/0x20 [ 2213.861073] [] bit_wait_io+0x11/0x50 [ 2213.865296] [] __wait_on_bit+0x65/0x90 [ 2213.868741] [] ? bit_wait+0x50/0x50 [ 2213.872668] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2213.877091] [] ? wake_bit_function+0x40/0x40 [ 2213.879758] [] __wait_on_buffer+0x2a/0x30 [ 2213.883524] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2213.886011] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2213.889942] [] read_blk+0x4c/0x60 [ 2213.892342] [] find_tree_dqentry+0x47/0x240 [ 2213.893996] [] find_tree_dqentry+0x1aa/0x240 [ 2213.895636] [] find_tree_dqentry+0x1aa/0x240 [ 2213.897670] [] find_tree_dqentry+0x1aa/0x240 [ 2213.899950] [] qtree_read_dquot+0x14c/0x380 [ 2213.906445] [] v2_read_dquot+0x2b/0x30 [ 2213.910208] [] dquot_acquire+0xe4/0x130 [ 2213.911958] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2213.917835] [] dqget+0x3fb/0x460 [ 2213.919521] [] __dquot_initialize+0x12d/0x230 [ 2213.927024] [] dquot_initialize+0x13/0x20 [ 2213.932039] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2213.934579] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2213.937093] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2213.940427] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2213.945562] [] obd_setup+0x167/0x540 [obdclass] [ 2213.947334] [] class_setup+0x54f/0x830 [obdclass] [ 2213.950019] [] class_process_config+0x149b/0x2660 [obdclass] [ 2213.952853] [] ? __kmalloc+0x1e0/0x340 [ 2213.954702] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2213.956498] [] do_lcfg+0x263/0x520 [obdclass] [ 2213.961252] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2213.963671] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2213.965543] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2213.967444] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2213.969233] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2213.972776] [] mount_nodev+0x4d/0xb0 [ 2213.981287] [] lustre_mount+0x18/0x20 [lustre] [ 2213.983583] [] mount_fs+0x39/0x1b0 [ 2213.987779] [] vfs_kern_mount+0x67/0x110 [ 2213.988995] [] do_mount+0x1ef/0xce0 [ 2213.990526] [] ? copy_mount_options+0x39/0x1b0 [ 2213.993024] [] SyS_mount+0x83/0xd0 [ 2213.999927] [] system_call_fastpath+0x1f/0x24 [ 2214.003676] BUG: scheduling while atomic: mount.lustre/21828/0x00000002 [ 2214.008561] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2214.088985] CPU: 2 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2214.096842] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2214.117695] Call Trace: [ 2214.122937] [] dump_stack+0x19/0x1b [ 2214.124238] [] __schedule_bug+0x64/0x72 [ 2214.140184] [] __schedule+0x791/0x7d0 [ 2214.148693] [] ? __blk_mq_try_issue_directly+0x165/0x180 [ 2214.155237] [] ? bit_wait+0x50/0x50 [ 2214.159878] [] schedule+0x29/0x70 [ 2214.165771] [] schedule_timeout+0x209/0x290 [ 2214.170907] [] ? kvm_clock_read+0x33/0x40 [ 2214.172432] [] ? kvm_clock_get_cycles+0x9/0x10 [ 2214.192308] [] ? ktime_get_ts64+0x4c/0xf0 [ 2214.193823] [] ? bit_wait+0x50/0x50 [ 2214.196928] [] io_schedule_timeout+0xad/0x130 [ 2214.201999] [] io_schedule+0x18/0x20 [ 2214.205681] [] bit_wait_io+0x11/0x50 [ 2214.209894] [] __wait_on_bit+0x65/0x90 [ 2214.215422] [] ? bit_wait+0x50/0x50 [ 2214.217190] [] out_of_line_wait_on_bit+0x81/0xb0 [ 2214.219557] [] ? wake_bit_function+0x40/0x40 [ 2214.222460] [] __wait_on_buffer+0x2a/0x30 [ 2214.224028] [] ldiskfs_bread+0x9f/0xe0 [ldiskfs] [ 2214.226298] [] ldiskfs_quota_read+0xee/0x150 [ldiskfs] [ 2214.230466] [] read_blk+0x4c/0x60 [ 2214.233372] [] find_tree_dqentry+0x47/0x240 [ 2214.236479] [] find_tree_dqentry+0x1aa/0x240 [ 2214.239717] [] find_tree_dqentry+0x1aa/0x240 [ 2214.242902] [] find_tree_dqentry+0x1aa/0x240 [ 2214.247011] [] qtree_read_dquot+0x14c/0x380 [ 2214.248852] [] v2_read_dquot+0x2b/0x30 [ 2214.251397] [] dquot_acquire+0xe4/0x130 [ 2214.256700] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2214.260832] [] dqget+0x3fb/0x460 [ 2214.266593] [] __dquot_initialize+0x12d/0x230 [ 2214.270574] [] dquot_initialize+0x13/0x20 [ 2214.288343] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2214.297574] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2214.307195] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2214.318085] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2214.325700] [] obd_setup+0x167/0x540 [obdclass] [ 2214.330762] [] class_setup+0x54f/0x830 [obdclass] [ 2214.334524] [] class_process_config+0x149b/0x2660 [obdclass] [ 2214.336819] [] ? __kmalloc+0x1e0/0x340 [ 2214.338526] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2214.344338] [] do_lcfg+0x263/0x520 [obdclass] [ 2214.357973] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2214.365172] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2214.371862] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2214.374352] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2214.377483] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2214.381974] [] mount_nodev+0x4d/0xb0 [ 2214.384117] [] lustre_mount+0x18/0x20 [lustre] [ 2214.388100] [] mount_fs+0x39/0x1b0 [ 2214.392517] [] vfs_kern_mount+0x67/0x110 [ 2214.394741] [] do_mount+0x1ef/0xce0 [ 2214.397627] [] ? copy_mount_options+0x39/0x1b0 [ 2214.400293] [] SyS_mount+0x83/0xd0 [ 2214.404121] [] system_call_fastpath+0x1f/0x24 [ 2214.409057] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2214.413429] in_atomic(): 1, irqs_disabled(): 0, pid: 21828, name: mount.lustre [ 2214.415583] CPU: 2 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2214.420393] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2214.423839] Call Trace: [ 2214.425737] [] dump_stack+0x19/0x1b [ 2214.430508] [] __might_sleep+0xd9/0x100 [ 2214.434547] [] __kmalloc+0x73/0x340 [ 2214.436712] [] ? getdqbuf+0x14/0x40 [ 2214.438218] [] getdqbuf+0x14/0x40 [ 2214.440097] [] find_tree_dqentry+0xaf/0x240 [ 2214.445217] [] find_tree_dqentry+0x1aa/0x240 [ 2214.449344] [] find_tree_dqentry+0x1aa/0x240 [ 2214.453157] [] find_tree_dqentry+0x1aa/0x240 [ 2214.457027] [] qtree_read_dquot+0x14c/0x380 [ 2214.460191] [] v2_read_dquot+0x2b/0x30 [ 2214.462995] [] dquot_acquire+0xe4/0x130 [ 2214.465554] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2214.468997] [] dqget+0x3fb/0x460 [ 2214.472825] [] __dquot_initialize+0x12d/0x230 [ 2214.475735] [] dquot_initialize+0x13/0x20 [ 2214.478932] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2214.482557] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2214.485734] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2214.488290] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2214.491446] [] obd_setup+0x167/0x540 [obdclass] [ 2214.494382] [] class_setup+0x54f/0x830 [obdclass] [ 2214.501829] [] class_process_config+0x149b/0x2660 [obdclass] [ 2214.504450] [] ? __kmalloc+0x1e0/0x340 [ 2214.508939] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2214.514728] [] do_lcfg+0x263/0x520 [obdclass] [ 2214.519595] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2214.527240] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2214.533721] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2214.541533] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2214.545823] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2214.550709] [] mount_nodev+0x4d/0xb0 [ 2214.553346] [] lustre_mount+0x18/0x20 [lustre] [ 2214.558638] [] mount_fs+0x39/0x1b0 [ 2214.563024] [] vfs_kern_mount+0x67/0x110 [ 2214.565870] [] do_mount+0x1ef/0xce0 [ 2214.570312] [] ? copy_mount_options+0x39/0x1b0 [ 2214.572283] [] SyS_mount+0x83/0xd0 [ 2214.578206] [] system_call_fastpath+0x1f/0x24 [ 2214.582308] BUG: scheduling while atomic: mount.lustre/21828/0x10000002 [ 2214.587720] Modules linked in: zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix libata [ 2214.626683] CPU: 2 PID: 21828 Comm: mount.lustre Kdump: loaded Tainted: P W OE ------------ 3.10.0-7.9-debug #1 [ 2214.632260] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2214.635535] Call Trace: [ 2214.644988] [] dump_stack+0x19/0x1b [ 2214.652033] [] __schedule_bug+0x64/0x72 [ 2214.656991] [] __schedule+0x791/0x7d0 [ 2214.660588] [] __cond_resched+0x26/0x30 [ 2214.664398] [] _cond_resched+0x3a/0x50 [ 2214.668083] [] __kmalloc+0x78/0x340 [ 2214.673237] [] ? getdqbuf+0x14/0x40 [ 2214.676614] [] getdqbuf+0x14/0x40 [ 2214.679225] [] find_tree_dqentry+0xaf/0x240 [ 2214.681956] [] find_tree_dqentry+0x1aa/0x240 [ 2214.684499] [] find_tree_dqentry+0x1aa/0x240 [ 2214.689563] [] find_tree_dqentry+0x1aa/0x240 [ 2214.696203] [] qtree_read_dquot+0x14c/0x380 [ 2214.698515] [] v2_read_dquot+0x2b/0x30 [ 2214.700239] [] dquot_acquire+0xe4/0x130 [ 2214.704153] [] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs] [ 2214.706234] [] dqget+0x3fb/0x460 [ 2214.707887] [] __dquot_initialize+0x12d/0x230 [ 2214.712050] [] dquot_initialize+0x13/0x20 [ 2214.715221] [] osd_ea_fid_set+0xaa/0x5a0 [osd_ldiskfs] [ 2214.718296] [] osd_mount+0xbaa/0xe50 [osd_ldiskfs] [ 2214.720392] [] osd_device_alloc+0x361/0xb30 [osd_ldiskfs] [ 2214.727461] [] ? lu_context_init+0xd6/0x1f0 [obdclass] [ 2214.732095] [] obd_setup+0x167/0x540 [obdclass] [ 2214.734371] [] class_setup+0x54f/0x830 [obdclass] [ 2214.737273] [] class_process_config+0x149b/0x2660 [obdclass] [ 2214.740311] [] ? __kmalloc+0x1e0/0x340 [ 2214.744059] [] ? do_lcfg+0x168/0x520 [obdclass] [ 2214.746111] [] do_lcfg+0x263/0x520 [obdclass] [ 2214.749957] [] lustre_start_simple+0x88/0x210 [obdclass] [ 2214.754496] [] server_fill_super+0xe3d/0x1950 [ptlrpc] [ 2214.757000] [] ? obd_zombie_barrier+0x4d/0xd0 [obdclass] [ 2214.758802] [] lustre_fill_super+0x91/0x4d0 [lustre] [ 2214.761701] [] ? ll_alloc_inode+0x140/0x140 [lustre] [ 2214.764194] [] mount_nodev+0x4d/0xb0 [ 2214.768364] [] lustre_mount+0x18/0x20 [lustre] [ 2214.771026] [] mount_fs+0x39/0x1b0 [ 2214.774579] [] vfs_kern_mount+0x67/0x110 [ 2214.778878] [] do_mount+0x1ef/0xce0 [ 2214.782589] [] ? copy_mount_options+0x39/0x1b0 [ 2214.786647] [] SyS_mount+0x83/0xd0 [ 2214.789024] [] system_call_fastpath+0x1f/0x24 [ 2215.134970] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2215.172194] Lustre: lustre-MDT0001: in recovery but waiting for the first client to connect [ 2216.336801] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 2217.237973] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2220.150076] Lustre: lustre-MDT0001-lwp-OST0001: Connection restored to (at 0@lo) [ 2220.158344] Lustre: Skipped 2 previous similar messages [ 2220.196282] Lustre: lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [ 2220.259138] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:65) [ 2221.517835] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 [ 2224.085512] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 [ 2226.870652] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 [ 2229.729768] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 [ 2232.981051] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 [ 2235.806754] Lustre: DEBUG MARKER: oleg413-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 [ 2343.656388] Lustre: DEBUG MARKER: == sanity-quota test 8: Run dbench with quota enabled ==== 07:52:17 (1750593137) [ 2351.538256] LustreError: 25518:0:(qsd_reint.c:620:qqi_reint_delayed()) lustre-OST0001: Delaying reintegration for qtype:1 until pending updates are flushed. [ 2351.543812] LustreError: 25518:0:(qsd_reint.c:620:qqi_reint_delayed()) Skipped 5 previous similar messages [ 2525.991361] Lustre: DEBUG MARKER: == sanity-quota test 9: Block limit larger than 4GB (b10707) ========================================================== 07:55:20 (1750593320) [ 2526.966583] Lustre: DEBUG MARKER: OST0_SIZE: 3564848 required: 4900000 [ 2531.242031] Lustre: DEBUG MARKER: == sanity-quota test 10: Test quota for root user ======== 07:55:25 (1750593325) [ 2555.757194] Lustre: DEBUG MARKER: == sanity-quota test 11: Chown/chgrp ignores quota ======= 07:55:50 (1750593350) [ 2579.430617] Lustre: DEBUG MARKER: == sanity-quota test 12a: Block quota rebalancing ======== 07:56:13 (1750593373) [ 2618.852478] Lustre: DEBUG MARKER: == sanity-quota test 12b: Inode quota rebalancing ======== 07:56:53 (1750593413) [ 2787.992063] Lustre: DEBUG MARKER: == sanity-quota test 13: Cancel per-ID lock in the LRU list ========================================================== 07:59:42 (1750593582) [ 2797.580424] Lustre: DEBUG MARKER: sanity-quota test_13: @@@@@@ FAIL: lock count(0) != + 1