In the same way we can visualize all the videos in a given SharePoint site using the Videos collection page, we can view the videos uploaded to a specific Team by adding the new Vides Page as a tab. We simply need to browse the channel where we want to add the tab, select the SharePoint pages tab in the Add a tab dialog and select the “SharePoint pages” tab:
Once we select that tab, among other available pages we will find “Videos”:
And you will get the following result (Note: As you can see, in my case I had already customized the Videos page in the site):