As far as Shi'ites is concerned,Idont think you can say across the board that they are all kaafir but there is a group that is those who believe the kaaba is a symbol of Ali (radiyallahu anhu),reject the quran,vilify the sahaabah etc)Then theres those who are somewhere inbetween,and then there are the zaidis.