Upgraded my connection from 150mbit to 400mbit.
Now my connection is terrible due problems in the downstream channels^^
Support will arrive today and hopefully fix it, given that I found out already what the problem is
If it stays terrible I'll inform you guys, I won't duel with a crappy ping for sure.