Blog Posts Per Page

Hello! Hopefully this is a simple question... Basically, I want my main/front page to display 3 blogs and the following pages to display 5. So, the main blog page only will show 3 blogs, and when the user goes to the next page of the blogs I would like to show 5 per page to follow. I'm sure it's a simple setting that I'm missing. I have it set to show 3 blogs on the main page, but it shows 3 posts per page, not just on the main page.

Thank you!