There is an option to set the number of displayed products per category page. Go to the Settings->General->Advanced->Product Num per Category Page to set this number.

For example, if the number is set as '21'
(as pictured below).

Then, when there are more than 21 products in that category, only 21 products will be displayed on the first page. The additional products will appear on 
subsequent pages.