I would say the controls are pretty responsive. You do kind of have to be aimed in the general direction of the screen for it to pick up, but you don't have to be pointing directly at it(I tend to hold the remote vertically while I'm playing). I'm not very good at the game yet, I have no trouble on easy, but medium and up is proving challenging...though it is more fun shaking along to the song on the higher difficulties, because the shakes match the music better as is usual for rhythm games.
I would say Samba de Amigo meets Guitar Hero is a good way to describe it, though those are both better games.
The hardest thing this game throws at you is not missing beats while blocking the other band's attacks. That's why I'm not so good on anything past easy right now, because on easy you can pretty much ignore the block button. Anything past easy though, blocking is vital.