Twilight Princess slow Hyrule

Hey i know your first thought is: this has been addressed! but i read every thread about this and none were absolutely addressed imo.

I just got past beating the kakariko village/goron mines. So im like 6 hours into the game and i havent encountered any problems. Just as i leave and enter Hyrule my fps drops dramatically. Is there anyway to fix this? From what ive read i just have to deal with it. I have ZTP hack on.