Most of the fighting fantasy game books were all in the same world. Lone Wolf books too. Both were amazingly successful, and I think part of that was because people became familiar with the game world and how it worked.
(Not picking on anyone's opinions, just talking about my own.)
So I say, have fun, and see how it works out.