Hi Megan,
I think it is pretty common for babies to get constipated from formula--especially when they first start drinking it. The solutions I've heard are to give the baby more water--however, my son was unwilling to drink water up until recently--so we added more water to his formula. Also we mix pureed prunes into his cereal and that has helped tremendously.
I hope that this problem gets better for you.