I use a pretty basic one (with an N100 microprocessor and intel integrated graphics) as a TV box + home server combo and its excellent for that.
It’s totally unsuitable for gaming unless we’re talking about stuff running in DOSEmu or similar and even then I’m using it with a wireless remote rather than a keyboard + mouse, which isn’t exactly suitable for PC gaming.
Mind you, there are configurations with dedicated graphics but they’re about 4x the price of the one I got (which cost me about €120) and at that point you’re starting to enter into the same domain as small form factor desktop PCs using things like standard motherboards, which are probably better for PC gaming simply because you can upgrade just about anything in those whilst hardware upgradeability of mini PCs is limited to only some things (like SDD and RAM).
I literally have two machines running on always on VPNs, one my personal PC and another a home server were a torrent service is running, and have no such problems.
I think maybe the mistake you made was spending most of the time with it OFF and then turning it ON once in a while, whilst mine just goes ON as soon as I boot my machine and stays on.
Granted, I’m not using it for getting around geo-locked websites, I’m using it for having a bit more privacy and for safety when sailing the high seas so once in a while I have the opposite problem (that I’m blocked from accessing sites in my own country because the connections appear to be coming from a different country).