I'd like to limit the maximum file size my users can upload to a document and/or asset library. So for example they cannot upload any file bigger than 100MB. Where can I set this?
No. The only thing you can do is set a limit per site collection.
For Sharepoint 2013 and 2016 this link on the Microsoft website explains the maximum file sizes.