So for the last week I've been holding off posting this just to be sure, but it appears I have completely stopped the CF crashing issue in my car altogether.

I just downloaded and installed the latest Prolific USB to Serial drivers. That's it.

It's a pretty logical conclusion considering I know not everyone is having this issue, but one way or another it does point the problem being outside Lap-time (and X-Port) which makes me feel better.

Here is a link to the drivers I used to fix my CF crashing woes while using XPort:
PL-2303 Software and Drivers
Note: Drivers last updated the 12th of Feb

If your hardware doesn't use a Prolific compatable chipset you may have to search elsewhere for your latest drivers.

Good luck!

Scott