While Bioshock has certain elements that are better (the integration of Plasmids into the story, the variety of Plasmids and weapons, and the weapon wheel,) I've always preferred the large, bright, open areas in Columbia compared to the claustrophobic feeling in Rapture.
Furthermore, I like how we're seeing the collapse of Columbia as it happens as opposed to going to Rapture almost a decade after the fact. It really makes the impact of the destruction feel more real.
It's not just the setting, but the level design that comes with it. Rapture always felt tight and confined. It's perfect for a horror setting, but it's not quite my cup of tea. Add to that the complete destruction of most areas and it loses that sense of wonder that the game wants build up to.
By contrast, Columbia is large and open. While the levels are, in reality, fairly linear, in most areas you feel like you have a lot more freedom to explore. The fact that most locations are outdoors with fighting happening in the streets, while Rapture is mostly an interior location because outside is ocean, helps out with that feeling.
I think most of the problems with Infinite would've be resolved if it wasn't a Bioshock game or if Bioshock was the subtitle. Like "INFINITE: BioShock" or "COLUMBIA: BioShock" or "RACIST SKY PEOPLE: BioShock."
Infinite's level design is even more restrictive than Bioshock. The level design is condensed into what can be summed up as a CoD-esque progression of sorts. Wholly linear, giving very few rewards for player exploration. If you're alright with being led around on a tour, then that's fine, but there are no moments where the level design blossoms beyond the occasional cover-shooter battlefield.
Bioshock 1 was pretty decent, and for a game in 2007, that's a fairly high standard. The plot, lore, and setting are good, but the biggest problems come from its gameplay. Primarily the usefulness of weapons and plasmids. The moral choices were all binary, and the final boss is a travesty. I'd give it a light 7/10.
@TorontRayne Seriously? System Shock 1? You want to put him through _that?_ It's been a while since I last went through that game, but I came away from it thinking "this is one of the first real FPSRPGs, and it really shows."