To set up project budgets in TimeCamp, navigate to the project settings and choose to assign a budget either by hours or monetary value. Once assigned, alerts will notify users when the budget reaches 80% and 100% utilization. This helps track whether your project is on budget and allows adjustments as needed.