Slow drop times

[ludfjig]

In hyperlight we noticed that dropping a MSHV vm fd seems to take around 40ms, which seems very excessive (compared to KVM's ~300 micro seconds). It would be great for us if this could be made faster.