Yes, I think we differ in some points. When I read a book or watch a movie, what I am primarily interested in is a good story. I have been doing quite some reading on narrative theory and agree with the theory that if the basic storytelling 101 is neglected, the entire book or movie fails. The first thing a story needs to work is a premise. A premise is a basic formula which sums up the entire story in one sentence. Take the original Star Wars film. Its premise was something like "belief in oneself triumphs over the greatest terror". The premise sets the theme, in this case spirituality vs technocracy and fortitude vs intimidation. It is the background against which the plot itself is developed. The plot in Star Wars revolves around a young boy who discovers that the potential that lies within himself is more powerful than the deadliest machines and the most ruthless villains.
Have you noticed something yet? We haven't lost a word on the setting so far. The story could take place anywhere and at any time. Since George Lucas opted to have it take place in an outer space environment, he needed to interpret the key elements of the plot in an appropriate manner. The idea of technocracy is turned into an ultimate battle station capable of destroying entire planets, and the villain is de-humanised by the fact that he was actually a man turned into a machine. The spiritual theme was interpreted in terms of the Force, which in the original film was actually a pretty vague concept that seemed to be more about discovering oneself. It was vague but it worked for the story. It later needed to be developed further in order to carry a much bigger story spread over many more films, but it still more or less retained its original idea. All the rest, the story about the Rebellion and the Empire, Princess Leia, Han Solo and so on is really just an afterthought to flesh out the setting and give the story a more interesting and vivid environment. I don't know how much of all this was in Lucas' mind when he wrote it, but that is not important because he got it right. Star Wars works as a story, and that's why I like it. I couldn't care less about if Bobba Fett could defeat a wookie in hand-to-hand combat.
With Lord of the Rings for instance, I can't find a real premise to the plot, nor could I narrow the story down to its basics and separate it from the setting. To me, it feels like the plot is just an excuse to present an elaborate setting that is all about the detail - which I couldn't care for less. I don't really know what the story is about. Is a bunch of fictional creatures trying to toss a ring into a volcano really a plot? Maybe I am missing something, but to me it's not a real story in the technical sense of the word. Now I'm not saying that everyone should agree with me, but only that this is how I feel about it. I enjoy Star Wars not primarily because of it's setting or it's universe, but because it's a good story. I don't enjoy The Lord of the Rings as much because I don't like the story. To me, the story is everything. All the rest is an afterthought, however cool or engaging it might be (and yes, light-saber duels are cool and engaging).