This is to anyone who is having the same issues as I had.
After Patch 1.05 I noticed my FPS had dropped from 60 down to 11, making the game unplayable.
After going through many options, I finally found the solution. Nvidia drivers.
Roll back or use DDU and install the previous version if you recently updated your nvidia drivers.

I have an AMD 3800X with a Asus 1080ti.

Nvidia driver that was causing the massive fps drop: 460.89
Nvidia driver that works well and give good FPS: 460.79