We have a SharePoint online tenant with Office E3 license, but when i access the Office 365 i can not find the Office 365 Videos app? so is this a license issue? or i need to create/configure the Office 365 portal first so users can start using it?
1Office 365 video is getting replaced by 'Stream'. It might be possible that your tenant got migrated already, which began on March 1, 2020. Check the details here: docs.microsoft.com/en-us/stream/migrate-from-office-365– UBKMay 2, 2020 at 23:36
Stream replaces Office 365 Video and I would suggest you use that, instead.
With that said, it is possible that newer tenants simply don't have the feature since the migration is in process already.