Depending on how much you are paying for your server, you may have to deal with certain limits. If you have a dedicated server, you can always change max file upload size and other PHP settings. Plugins such as Big File Uploads also help. It lets you get around the upload limits on your server to upload larger files to your media library.
Thanks to this plugin, you can upload very large files without having to rely on a SFTP client. You can also set max file size for each user role. It also has a disk utility feature, so you can make sense of how you are using your space. This plugin uploads files in chunks to get around your server limits.