does it only give mana?

Yes, also it increases the base effect for charms. For every 25 stat points you have in intelligence, you gain +1 Mana Regen. Every Level Up you will gain an amount of mana equal to your base intelligence.

Also.... it adds for defense vs casters... imo int on a barb is worthless