I probably would've gotten more into IV if I'd been able to get the hang of the cars. Mostly, my sense of IV was that it was seriously overhyped (though I played it probably 3-4 years after it'd come out). Yeah, great, you can go on dates and make your controller vibrate, or you can shoot pigeons, or just car jack people and drive erratically. After a while, that got boring for me, particularly since I was locked into various parts of the city, and couldn't move past them without doing story missions -- which were all on rails anyway.
I played on the 360 and just got tired of feeling like I was fighting the game for control of the avatars. The camera was always slow to respond, and the vehicles (and even people) just were INCREDIBLY sluggish.
With L.A. Noire, the game had a lot less free-roaming, but a much tighter and engaging story. I found the cars reasonably simple to control if only because they were more responsive. Plus, I wasn't usually having to race other cars which could turn on a dime even though I was turning like a battleship run aground. I liked the setting of L.A. Noire a lot more, too, which probably had a fair bit to do with my enjoyment of it.
By contrast, althuogh it was goofy and TOTALLY over the top, I found Saints Row 3 to be an absolute blast to play. The story was totally insane, but it was just FUN. I spent a bunch of time doing side gigs, too, and thoroughly enjoyed myself. I think a lot of that had to do with a much better control system.
Hopefully V will have improved controls. I'd LIKE to be able to get into these games, and I do see the potential for them, but so often it just feels like they spent a lot of time making the game "big" rather than actually "good." Or at least that's how I felt about IV.