Passengers want to accompany friends and family to the gate. Airports want more people shopping and dining, they earn a percentage of the revenue at all the merchants at the airport. And by the way airlines usually share in this revenue, too.
The TSA wants to limit the number of people going through security. They also want to limit the bags they have to screen at the checkpoint. The TSA is the government, so until now they’ve gotten to decide.