It's more than manias and panics (though they played a large part). The legal and institutional framework surrounding it is still in constant flux, and its future value will depend heavily upon that.

Right now the institutional news all looks negative -- e.g. the failure of mt gox and the unfavorable tax treatment in Japan (and now the US).