Typically under counter units are just filters.
 
A true water softener needs a resin tank and usually a salt tank.  Most of these will be too large for an undersink application.
 
Any big box store will have a wide selection of under sink filters, pick the one that provides the level of filtration you need.