George R.R. Martin has put forward the theory of genre (by this, the common public perception of the genres) as just "furniture" -- that setting stuff can be swapped around willy-nilly, but the bones of the story you're telling can remain.

That strikes me as one way of trying to pick out where genre is and isn't. If you can swap it out for something else without changing the fundamental narrative, it's part of the furniture.