I think downvotes are part of a healthy ecosystem if used as what they are meant for (bad actors, spam, abuse). However, some downvotes can hurt users especially if they are done just because of so-called whale wars or something similar.