Savegames between HLE and LLE not interchangable?

Hi,
I'm playing Zelda twilight princess with dolphin but the audio glitches get annoying after a while so I decided to use LLE instead of HLE. This seems to work better. Thing is dolphin crashes when I try to load a savegame which was created with HLE audio. Are they really not interchangable or did I oversee something?

Thanks in advanced