Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 13 Nov 2014 00:08:40 +0200
From:      Tinker <tinkr@openmailbox.org>
To:        Allan Jude <allanjude@freebsd.org>
Cc:        owner-freebsd-virtualization@freebsd.org, freebsd-virtualization@freebsd.org
Subject:   Re: How hard is BHyVe's 16 vCPU limit, is it configurable under any =?UTF-8?Q?circumstance=3F?=
Message-ID:  <49cc2695179830c899aef87b7a8b72d8@openmailbox.org>
In-Reply-To: <5463D746.4030803@freebsd.org>
References:  <8e39523570b667d223091adc3791c9e2@openmailbox.org> <5463D746.4030803@freebsd.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On 2014-11-12 23:55, Allan Jude wrote:
> On 2014-11-12 16:39, tinkr@openmailbox.org wrote:
>> Hi!
>> 
>> In order justify giving energy to BHyVe, I need to know if it's
>> "future-proof" in that the 16 vCPU limit can be increased?
>> 
>> Please let the world know if BHyVe's 16 vCPU limit can be lifted in 
>> some
>> way, by configuration, patch, etc. (and if you want to, why this limit
>> is in place by default today).
>> 
>> Thanks!!
>> Tinker
>> 
>> _______________________________________________
>> freebsd-virtualization@freebsd.org mailing list
>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
>> To unsubscribe, send any mail to
>> "freebsd-virtualization-unsubscribe@freebsd.org"
> 
> You can increase the limit by editing sys/amd64/include/vmm.h
> 
> #define VM_MAXCPU       16
> 
> From what I've been told, things scale badly above 24 CPUs. They plan 
> to
> solve this issue, but have not yet. If you system has enough cores to
> support using more than 16 per VM, you can modify the file and 
> recompile
> the kernel and use as many CPUs as you want, but not much testing has
> happened with bigger numbers.

Dear Allan,

Thank you very much for responding.

Aha, great!


Only for completeness, do you have any particular idea about
  * When the scaling above 24 vCPU:s will be optimized, like approx how 
many years away is it (like 1 or more than 1)?, and
  * What the technological reason for the scaling is, is it that somehow 
the BHyVe instances on the different cores need to inter-communicate, 
for instance that all disk and network IO is done via one single core 
currently?


In all cases, your response is great news, as your baseline answer that 
it's doable and only a question of optimization and tweaking of present 
functionality -

Thanks again!
Tinker




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?49cc2695179830c899aef87b7a8b72d8>