Modern BOINC client (like 8.0.4) correctly working with GPU with RDP is using, but the itself project isn't.

I think this is a common problem at every project while you are remotely connected to it, but once you disconnect it should start back up again, that's the way it works in my Windows setup anyway.