My PC sometimes will randomly freeze, everything just stuck, with minimal programs up, Chrome, or something simple, a folder, doesn't matter. This happens after my PC has been on for only a few minutes, screen freezes, and then everything goes black after about 5 seconds. Have to reboot.

However, sometimes when starting up, nothing happens, no bios, no windows, nothing, just black and the PC will turn it self off and back on. Sometimes when this happens, I have to hold the power button and reboot it and then it boots up.

CPU fan is on, along with the power light when all of this happens.

What should I be testing? GPU, Ram, Power?

Could this be related to a short somewhere? I've noticed my PC has had issues anytime I have a LED lights plugged in since I got them, I've unplugged it and we'll see if I have any power issues. Super frustrating, but you wouldn't think a LED Light would cause it to do this, has to be something else, has been acting up weird the past month and I've had that LED Lights for a couple years

Change PSU
disassemble and look for shorts as you already suggested.

check power supply unit

Alright, fully replaced the PSU, and I'm still experiencing issues, the same issues to be exact. The weird thing is, I can hear a light static clicking like noise when starting up the PC until it reaches Windows every half second/full second. I've also noticed when listening to something right away when the PC has been booted it makes that noise and sounds like it's skipping just a touch bit on the sound.

Is this a motherboard issue, or RAM? I've tested CHKDsk on the Harddrives. I've literally tried unplugging Case Fans, and LED lights, same issue so the short isn't there.

Is the distances mounted behind mobo?

Can I get a little more detail on what you mean by that?