I have to say, I used to have a rabbit a few years ago called Smokey.
One of the worst pets I've ever had.
I used to pet and hug her all the time, and she was horrid. I still have scars from her and this is probably nearly 8 years ago!
One time I had her out of the cage, showing my grandparents her, and she was used to be held, she for no reason, ran up my face. I have 2 scars on my cheeks from her nails.
Like kayleighjennifer has said, they also cost a fortune.
You need to get them vaccined every year, and they come with lots of health issues. I remember my dad having to shell out lots of money over her, due to her having dodgy teeth. That's on top of the cage, and all the bits and bobs you need like food, hay, sawdust etc.
They're a pain. If I were you, I'd stick with guineas, at least you know what to expect them them

x
I totally agree with the aggression part, my 2.4kg male could easily break my arm if I didnt pick him up correctly he is highly nervous and refuses to be picked up or stroked, his girlfriend refuses any cuddles and is a little aggressive over me picking her up. Rabbits hate being picked up and will be happy to lash out, scratching biting anything to get down!
Housing wise mine all have their own bedrooms and are litter trained, mine react very badly to being caged they rattle the bars, try and dig their way out and get very stressed in them
Lola is my very special rabbit and I wouldn't change her for the world, shes unspayed due to health reasons but my goodness that rabbit doesnt have a bad bone in her body! She will sits for hours getting cuddles, she tollerates being held, shes not scared by anything, sits and licks me for ages and loves the piggies (when I have them out she comes up and grooms them) however I would never have them together at floor level or have them left unsupervised. Sadly Lola is going blind but its not bothering her at the moment, the catarcts in her eyes are getting bigger and its over £3000 to get them removed.
I have been told I am very lucky to have a female rabbit to be so loving and caring, shes so badly bred its such a shame, although she was a "planned" litter (her owners wanted cold hard cash) shes got very bad genetics her siblings havent lasted more than 1/2 years and the one sister I am still in contact with isn't healthy either. If anyone would ever want to breed their rabbits they should have the health and history of at least 3 generations, rabbits are so over bred these days its disgusting grrrr
Rabbits are also known to "just die" however this isn't true rabbits will hide any sign of pain and will still act "normal" you have to watch for the slightests of changes in rabbits and keep on top of their health 24/7. I have to listen to Lola's gut twice a day to make sure she isn't having a gut slow down and going into stasis.
For a first time owner of a rabbit it is very intense, everything happens so quickly with rabbits and although they need a friend they can end up fighting and injuring one another, boys are a fairly hard bond at the best of times but it is possible.
Also exercise and play time, I have spent a small fortune on toys just to keep them entertained and happy, they will get through toys like no tomorrow, if they are housed outdoors they need 6ft+ runs and need daily exercise. If kept in the house they will happily do a little re-wiring for you, Lola also has taken up interior desgining

|)
All in all, knowing what I know I wouldn't personally have any more rabbits after my current rabbits pass, they are amazing pets but are too much of a constant worry. Guinea pigs are much easier pets to care for and much less demanding, less aggressive and get along in much bigger groups than rabbits if not neutered (same sex pairs).
http://forums.rabbitrehome.org.uk/ <-- Check this rabbit forum out for more info on rabbits
