I see a problem with automated downvotes and would suggest to allow downvotes only by hand.

I agree with you. You need to trust a person very much to actually delegate your downvotes. I never used them and when you get dowvotes and you see people that you actually consider your friends following a downvote... it's not that healthy...