I don't think I went into the BIOS and manually set it, no.

If both GPU's are running at the same time - what does that hurt? Wouldn't that just mean by GPU is less stressed if it's able to use both?

Your RX6800XT won't need any help, to avoid any conflictions I would just go into Bios & make the appropriate change.

High GPU utilization is what you want when gaming & your GPU is way more than capable.

Lots of newer computers these days can have a dedicated GPU and integrated run perfectly fine. When your not running anything resource intensive your PC can use the iGPU, but when it switches to a load that it can't handle, your dedicated GPU should pick it right up. You should have settings in the driver software somewhere to specify what GPU to use for what games, it just sounds like it's not detecting it right. There should be no need to disable the iGPU. Look in your AMD settings or your windows settings, there's probably 2 different ways to do it. https://www.amd.com/en/support/kb/faq/gpu-110

You might be experiencing this because your not on the latest driver, or since D4 is such a new game there isn't a graphics profile for it yet from the device manufacturer so it's not even attempting to use the dedicated GPU when you load it.

I don't know what I did but I was able to disable the iGPU now and it works perfectly fine. Now my only issue is the cycling it does before going into windows. My motherboard will stay on an orange light for about 20 seconds, go to a red light for 2 seconds, white light for 2 secs, green light for 2 seconds then will boot to windows. The orange light is supposed to be related to RAM but I don't see anything wrong with it. Anyone else have this issue?

Are you using the correct ram slots as per the motherboard manual if you are using two sticks? (DIMM A/B vs. C/D), look at ram configs in your motherboard manual.

If it's correct I'd suggest updating your bios, load optimized defaults, then go to your boot order and remove any redundancies, then disable iGpu in your bios again.

Yeah if you're using 2x Ram sticks make sure they are in A1/B1 config or A2/B2
Check task manager to see if both your ram sticks are actually being recognized and operating properly
Chances are it could be faulty ram, 1 single faulty ram stick or faulty ram slots on the MOBO
Your PC will still boot if it has 1x functioning ram stick
If you get what I'm putting down

yes and to further test this once you've checked above you can just put in 1 stick (see motherboard manual again) at a time and test if it boots with just 1 stick, if it works with 1 and doesnt with the other.... there's your problem

100%

Yes, I'm using the correct RAM slots - it tells you which ones on the motherboard to use. I already updated the BIOS. The iGPU isn't a problem any longer it's the orange light staying on

Both are recognized and to know I know are working properly. If there's any screenshots I can take for you to look at lmk