Rising costs and steep tuition discounts are squeezing college budgets just as the pool of prospective students begins to shrink.