SharePoint O365 upload big file via CSOM

Question

I am tring to upload large files (900 MB) to SP Online (actually the OneDrive Business) but seems to follow SP style.

Tried this via CSOM and powershell 70 MB are fine but when I try 900 MB a timeout happens after 3min

Error :

Exception calling "ExecuteQuery" with "0" argument(s): "The operation has timed out" At C:\scripts\BackupToCloud\BackupToCloud1.ps1:89 char:1 + $ctx.ExecuteQuery() + ~~~~~~~~~~~~~~~~~~~ + CategoryInfo : NotSpecified: (:) [], MethodInvocationException + FullyQualifiedErrorId : WebException

My upload part (of the script):

Foreach ($File in (dir $LocalBckupFolder))
{
    $StartAFile = get-date -uformat "%Y-%m-%d %H:%M:%S"
    Add-Content $log "$StartAFile :: Start Upload file: $File.name"
    $FileStream = New-Object IO.FileStream($File.FullName,[System.IO.FileMode]::Open)
    $FileCreationInfo = New-Object Microsoft.SharePoint.Client.FileCreationInformation
    $FileCreationInfo.Overwrite = $true
    $FileCreationInfo.ContentStream = $FileStream
    $FileCreationInfo.URL = $File
    $Upload = $SPfolder.Files.Add($FileCreationInfo)
    $ctx.Load($Upload)
    $ctx.ExecuteQuery()
    $FinishAFile = get-date -uformat "%Y-%m-%d %H:%M:%S"
    Add-Content $log "$FinishAFile :: Done Upload file: $File.name"
}

$ctx.Dispose()

Try to use $ctx.RequestTimeout = = 3600000; or $ctx.RequestTimeout = int.MaxValue; but this is not recognized. As SharePoint Online doesn't offer the Get-SPWebApplication I can't set timeout there as I could on premise (no Get-SPOWebApplication available).

Also if large file upload via powershell to O365 (SP or OneDrive) should be done differently I'm open for suggestions.

Answer 1

Please see an example below:

$username = "[email protected]" 
$password = "Password" 
$url = "https://domain.sharepoint.com/sites/Test"
$path = "C:\temp\test";
$destination = $url + "/Shared Documents"; #lib partial url

$securePassword = ConvertTo-SecureString $Password -AsPlainText -Force 

# the path here may need to change if you used e.g. C:\Lib.. 
Add-Type -Path "c:\Program Files\Common Files\microsoft shared\Web Server Extensions\15\ISAPI\Microsoft.SharePoint.Client.dll" 
Add-Type -Path "c:\Program Files\Common Files\microsoft shared\Web Server Extensions\15\ISAPI\Microsoft.SharePoint.Client.Runtime.dll" 

# connect/authenticate to SharePoint Online and get ClientContext object.. 
$credentials = New-Object Microsoft.SharePoint.Client.SharePointOnlineCredentials($username, $securePassword) 

$webclient = New-Object System.Net.WebClient;
$webclient.Headers["Cookie"] = $credentials.GetAuthenticationCookie($url)

Get-ChildItem $path | Where-Object {$_.Length -gt 0} | ForEach-Object { 
    $webclient.UploadFile($destination + "/" + $_.Name, "PUT", $_.FullName); 
};

I have used PUT method to upload files

Answer 2

Check this out it will help you Large file upload in SharePoint Online with CSOM PowerShell

Answer 3

If you could try writing a console application with CSOM, this could be achieved. Please refer to the Office Dev PnP link.

PS: Sorry I am not sure about powershell.

Answer 4

Find a different solution for files of that size, SharePoint cannot handle them.