Same issue. MacMini with 16G, dual 4K monitors, and the whole thing runs slow. Removing the DisplayLink and using only a single monitor plugged directly into the Mini and the whole system is quick and responsive with the same apps running but without the DisplayLink driver.
Also, watching top I see that DisplayLink is sucking up huge amounts of CPU time.
Same issue. MacMini with 16G, dual 4K monitors, and the whole thing runs slow. Removing the DisplayLink and using only a single monitor plugged directly into the Mini and the whole system is quick and responsive with the same apps running but without the DisplayLink driver.
Also, watching top I see that DisplayLink is sucking up huge amounts of CPU time.