Try giving water at the same temperature that you would give milk, my LO is now fine with water but not at the beginning, I introduced water when I started solids with her (at milk temperature), now she is happy to take it at room temperature. She drinks water with every meal now from a sippy cup but originally from a bottle.