I could probably be more coherent if I weren't typing this between calls at work, but from my perspective, Science Fiction starts from the "Real" and extrapolates, while Fantasy starts with the "Unreal."

Alternate history isn't "Unreal" it's just differently "Real".

...if that makes sense.