Re:The final step for huge-page swapping
by deckiedan on Tuesday July 03, 2018 @09:04PM
(#17454692)
All those quoted performance improvements sound great - but what kind of Real World workload or environment would one need to be in to see this in action? Anywhere when swapping? Or does it need to be with special hardware? Would a SSD backed low-memory VM be improved?
[ Parent
| on HN ]
Re:The final step for huge-page swapping
by saas_co_de on Wednesday July 04, 2018 @06:23AM
(#17456325)
All sorts of cloud hosting things would benefit from this. The ability to swap in and out very fast allows you to run more containers or vms on the same machine in cases where only a percentage of those instances are utilized at any given time but even if one is swapped out it must be able to swap in and respond with reasonable latency.
Any kind of "serverless" hosting or any architecture where you have a container per user would benefit from this kind of development.
Re:The final step for huge-page swapping
by Baech8ei on Wednesday July 04, 2018 @10:13AM
(#17457356)
If nvme swap gets faster too with huge pages then testing a whole microservice swarm on a local dev machine might benefit from it when the currently idle services can be swapped more swiftly while something chews on data.
Re:The final step for huge-page swapping
by senozhatsky on Tuesday July 03, 2018 @10:02PM
(#17454849)
> but what kind of Real World workload or environment would one need to be in to see this in action?
Hmm, Facebook perhaps.
Emedded devices tend to use zswap/zram which [yet] don't support THP, as far as I know. For instance, take a look at zswap_frontswap_store():
/* THP isn't supported */
if (PageTransHuge(page)) {
ret = -EINVAL;
goto reject;
}
Once zswap [and, perhaps, zram] gain THP swap out/in
support, embedded devices [some of which use swap quite
heavily] should also see a considerable performance
improvement.P.S. I didn't check the patch set, may be zswap THP support is already in there.
-ss
Re:The final step for huge-page swapping
by senozhatsky on Wednesday July 04, 2018 @01:09AM
(#17455375)
A followup: zswap THP support is not implemented yet. Huang Ying agreed that it would be interesting to have it, but it's not on his TODO list as of now.
-ss