Onedrive Data Transfer - Revision history

Mozes: Remove the module info

2023-07-24T21:38:44Z

Remove the module info

← Older revision		Revision as of 16:38, 24 July 2023
Line 23:		Line 23:

	<ol start="3">		<ol start="3">
	~~<li>At the command prompt in the shell that opens, load the rclone module by entering the command below at the prompt:</li>~~
	~~</ol>~~
	~~===Load the Rclone module===~~
	~~<pre>~~
	~~[mozes@gremlin01 ~]$ module load rclone~~
	~~</pre>~~
	~~<ol start="4">~~
	<li>We will need to start the basic configuration for OneDrive. To do this run rclone config:</li>		<li>We will need to start the basic configuration for OneDrive. To do this run rclone config:</li>
	</ol>		</ol>
Line 36:		Line 29:
	[mozes@gremlin01 ~]$ rclone config		[mozes@gremlin01 ~]$ rclone config
	</pre>		</pre>
	<ol start="5">		<ol start="4">
	<li>In a new configuration, you will see no remotes found. Enter n to make a new remote and name it a name you will know. In our example, we will use “myOneDrive”. Select Microsoft OneDrive by entering in the corresponding number, in our case 27. Hit Enter for the client_id, client_secret, and Edit advanced config. When you are prompted for auto config, select n. The terminal will stop at a result> prompt. Proceed to the next step.</li>		<li>In a new configuration, you will see no remotes found. Enter n to make a new remote and name it a name you will know. In our example, we will use “myOneDrive”. Select Microsoft OneDrive by entering in the corresponding number, in our case 27. Hit Enter for the client_id, client_secret, and Edit advanced config. When you are prompted for auto config, select n. The terminal will stop at a result> prompt. Proceed to the next step.</li>
	</ol>		</ol>
Line 85:		Line 78:
	result>		result>
	</pre>		</pre>
	<ol start="6">		<ol start="5">
	<li>Now open up another terminal window on the virtual desktop by clicking again on the Terminal Emulator icon at the bottom of the window.</li>		<li>Now open up another terminal window on the virtual desktop by clicking again on the Terminal Emulator icon at the bottom of the window.</li>
	</ol>		</ol>
	In the new shell that opens, ~~load the rclone module like you did in the first shell with module load rclone, and then~~ run rclone authorize "onedrive" at the command prompt. You will be prompted to go to a 127.0.0.1 address in a web browser.		In the new shell that opens, run rclone authorize "onedrive" at the command prompt. You will be prompted to go to a 127.0.0.1 address in a web browser.
	===Authorize OneDrive from the terminal===		===Authorize OneDrive from the terminal===
	<pre>		<pre>
	~~[mozes@gremlin01 ~]$ module load rclone~~
	[mozes@gremlin01 ~]$ rclone authorize "onedrive"		[mozes@gremlin01 ~]$ rclone authorize "onedrive"
	If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth		If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth
Line 162:		Line 154:
	[mozes@gremlin01 ~]$ rclone ls myOneDrive:/		[mozes@gremlin01 ~]$ rclone ls myOneDrive:/
	</pre>		</pre>
	<ol start="7">		<ol start="6">
	<li>To upload or download files, use the rclone copy command. For example:</li>		<li>To upload or download files, use the rclone copy command. For example:</li>
	</ol>		</ol>
Line 185:		Line 177:
	[mozes@gremlin01 ~]$ rclone copy ./SomeFile.txt myOneDrive:/		[mozes@gremlin01 ~]$ rclone copy ./SomeFile.txt myOneDrive:/
	</pre>		</pre>
	<ol start="8">		<ol start="7">
	<li>To download directories, use the rclone copy command and use directory names over file. This copies the contents of the folders, so you need to specify a destination folder.</li>		<li>To download directories, use the rclone copy command and use directory names over file. This copies the contents of the folders, so you need to specify a destination folder.</li>
	</ol>		</ol>
Line 198:		Line 190:
	[mozes@gremlin01 ~]$ rclone copy ./my_beocat_dir myOneDrive:/my_beocat_dir		[mozes@gremlin01 ~]$ rclone copy ./my_beocat_dir myOneDrive:/my_beocat_dir
	</pre>		</pre>
	<ol start="9">		<ol start="8">
	<li>Rclone also supports using sync to transfer files, similar to rsync. The syntax is similar to rclone copy. This would only transfer files that are updated by name, checksum, or time. The example below would sync the files of the local directory to the remote directory on OneDrive.</li>		<li>Rclone also supports using sync to transfer files, similar to rsync. The syntax is similar to rclone copy. This would only transfer files that are updated by name, checksum, or time. The example below would sync the files of the local directory to the remote directory on OneDrive.</li>
	</ol>		</ol>

Mozes at 18:10, 3 May 2023

2023-05-03T18:10:33Z

← Older revision		Revision as of 13:10, 3 May 2023
Line 26:		Line 26:
	</ol>		</ol>
	===Load the Rclone module===		===Load the Rclone module===
	<~~syntaxhighlight~~>		<pre>
	[mozes@gremlin01 ~]$ module load rclone		[mozes@gremlin01 ~]$ module load rclone
	</~~syntaxhighlight~~>		</pre>
	<ol start="4">		<ol start="4">
	<li>We will need to start the basic configuration for OneDrive. To do this run rclone config:</li>		<li>We will need to start the basic configuration for OneDrive. To do this run rclone config:</li>
	</ol>		</ol>
	===Load the rclone config===		===Load the rclone config===
	<~~syntaxhighlight~~>		<pre>
	[mozes@gremlin01 ~]$ rclone config		[mozes@gremlin01 ~]$ rclone config
	</~~syntaxhighlight~~>		</pre>
	<ol start="5">		<ol start="5">
	<li>In a new configuration, you will see no remotes found. Enter n to make a new remote and name it a name you will know. In our example, we will use “myOneDrive”. Select Microsoft OneDrive by entering in the corresponding number, in our case 27. Hit Enter for the client_id, client_secret, and Edit advanced config. When you are prompted for auto config, select n. The terminal will stop at a result> prompt. Proceed to the next step.</li>		<li>In a new configuration, you will see no remotes found. Enter n to make a new remote and name it a name you will know. In our example, we will use “myOneDrive”. Select Microsoft OneDrive by entering in the corresponding number, in our case 27. Hit Enter for the client_id, client_secret, and Edit advanced config. When you are prompted for auto config, select n. The terminal will stop at a result> prompt. Proceed to the next step.</li>
	</ol>		</ol>
	===Configure OneDrive===		===Configure OneDrive===
	<~~syntaxhighlight~~>		<pre>
	[mozes@gremlin01 ~]$ rclone config		[mozes@gremlin01 ~]$ rclone config
	No remotes found - make a new one		No remotes found - make a new one
Line 84:		Line 84:
	Then paste the result below:		Then paste the result below:
	result>		result>
	</~~syntaxhighlight~~>		</pre>
	<ol start="6">		<ol start="6">
	<li>Now open up another terminal window on the virtual desktop by clicking again on the Terminal Emulator icon at the bottom of the window.</li>		<li>Now open up another terminal window on the virtual desktop by clicking again on the Terminal Emulator icon at the bottom of the window.</li>
Line 90:		Line 90:
	In the new shell that opens, load the rclone module like you did in the first shell with module load rclone, and then run rclone authorize "onedrive" at the command prompt. You will be prompted to go to a 127.0.0.1 address in a web browser.		In the new shell that opens, load the rclone module like you did in the first shell with module load rclone, and then run rclone authorize "onedrive" at the command prompt. You will be prompted to go to a 127.0.0.1 address in a web browser.
	===Authorize OneDrive from the terminal===		===Authorize OneDrive from the terminal===
	<~~syntaxhighlight~~>		<pre>
	[mozes@gremlin01 ~]$ module load rclone		[mozes@gremlin01 ~]$ module load rclone
	[mozes@gremlin01 ~]$ rclone authorize "onedrive"		[mozes@gremlin01 ~]$ rclone authorize "onedrive"
Line 100:		Line 100:
	{"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"}		{"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"}
	<---End paste		<---End paste
	</~~syntaxhighlight~~>		</pre>
	Right-click on the link and select open link from the menu. A browser window will open on the virtual desktop. On the Microsoft Office sign-in page that opens enter in your KSU e-mail address and click “Next”. You will be taken to your eID single sign-on page where you can sign in using your KSU eID credentials. If login is successful, you should be redirected to a page that says “Success!”		Right-click on the link and select open link from the menu. A browser window will open on the virtual desktop. On the Microsoft Office sign-in page that opens enter in your KSU e-mail address and click “Next”. You will be taken to your eID single sign-on page where you can sign in using your KSU eID credentials. If login is successful, you should be redirected to a page that says “Success!”

Line 110:		Line 110:

	===Authorize OnDemand on cluster===		===Authorize OnDemand on cluster===
	<~~syntaxhighlight~~>		<pre>
	result> {"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"}		result> {"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"}
	Choose a number from below, or type in an existing value		Choose a number from below, or type in an existing value
Line 155:		Line 155:
	q) Quit config		q) Quit config
	e/n/d/r/c/s/q> q		e/n/d/r/c/s/q> q
	</~~syntaxhighlight~~>		</pre>
	Now test the connection by running the ls command. You should see a listing of your OneDrive files.		Now test the connection by running the ls command. You should see a listing of your OneDrive files.

	=== List contents of OneDrive ===		=== List contents of OneDrive ===
	<~~syntaxhighlight~~>		<pre>
	[mozes@gremlin01 ~]$ rclone ls myOneDrive:/		[mozes@gremlin01 ~]$ rclone ls myOneDrive:/
	</~~syntaxhighlight~~>		</pre>
	<ol start="7">		<ol start="7">
	<li>To upload or download files, use the rclone copy command. For example:</li>		<li>To upload or download files, use the rclone copy command. For example:</li>
Line 181:		Line 181:
	[[File:ood_remote_copy_finished.png\|rclone copy finished]]		[[File:ood_remote_copy_finished.png\|rclone copy finished]]
	==== Command Line ====		==== Command Line ====
	<~~syntaxhighlight~~>		<pre>
	[mozes@gremlin01 ~]$ rclone copy myOneDrive:/SomeFile.txt ./		[mozes@gremlin01 ~]$ rclone copy myOneDrive:/SomeFile.txt ./
	[mozes@gremlin01 ~]$ rclone copy ./SomeFile.txt myOneDrive:/		[mozes@gremlin01 ~]$ rclone copy ./SomeFile.txt myOneDrive:/
	</~~syntaxhighlight~~>		</pre>
	<ol start="8">		<ol start="8">
	<li>To download directories, use the rclone copy command and use directory names over file. This copies the contents of the folders, so you need to specify a destination folder.</li>		<li>To download directories, use the rclone copy command and use directory names over file. This copies the contents of the folders, so you need to specify a destination folder.</li>
	</ol>		</ol>
	===== Download a directory from OneDrive =====		===== Download a directory from OneDrive =====
	<~~syntaxhighlight~~>		<pre>
	[mozes@gremlin01 ~]$ rclone copy myOneDrive:/my_beocat_dir ./my_beocat_dir		[mozes@gremlin01 ~]$ rclone copy myOneDrive:/my_beocat_dir ./my_beocat_dir
	</~~syntaxhighlight~~>		</pre>
	To upload a directory named my_beocat_dir to OneDrive, use rclone copy.		To upload a directory named my_beocat_dir to OneDrive, use rclone copy.

	===== Upload a directory to OneDrive =====		===== Upload a directory to OneDrive =====
	<~~syntaxhighlight~~>		<pre>
	[mozes@gremlin01 ~]$ rclone copy ./my_beocat_dir myOneDrive:/my_beocat_dir		[mozes@gremlin01 ~]$ rclone copy ./my_beocat_dir myOneDrive:/my_beocat_dir
	</~~syntaxhighlight~~>		</pre>
	<ol start="9">		<ol start="9">
	<li>Rclone also supports using sync to transfer files, similar to rsync. The syntax is similar to rclone copy. This would only transfer files that are updated by name, checksum, or time. The example below would sync the files of the local directory to the remote directory on OneDrive.</li>		<li>Rclone also supports using sync to transfer files, similar to rsync. The syntax is similar to rclone copy. This would only transfer files that are updated by name, checksum, or time. The example below would sync the files of the local directory to the remote directory on OneDrive.</li>
	</ol>		</ol>
	===== Sync changed files =====		===== Sync changed files =====
	<~~syntaxhighlight~~>		<pre>
	[mozes@gremlin01 ~]$ rclone sync ./my_beocat_dir myOneDrive:/my_beocat_dir		[mozes@gremlin01 ~]$ rclone sync ./my_beocat_dir myOneDrive:/my_beocat_dir
	</~~syntaxhighlight~~>		</pre>

	== Potential issues ==		== Potential issues ==

Mozes at 17:53, 19 April 2023

2023-04-19T17:53:23Z

← Older revision		Revision as of 12:53, 19 April 2023
Line 170:		Line 170:

	First you'd select the endpoint and files/folder you would like to copy or move. Then you would click the copy/move button near the top.		First you'd select the endpoint and files/folder you would like to copy or move. Then you would click the copy/move button near the top.

	[[File:ood_remote_copy_selection.png\|rclone copy file selection]]		[[File:ood_remote_copy_selection.png\|rclone copy file selection]]

	The you would traverse to the location where you would like to copy/move the files/folders to and then you would click the copy or move button on the left.		The you would traverse to the location where you would like to copy/move the files/folders to and then you would click the copy or move button on the left.

	[[File:ood_remote_copy_action.png\|rclone remote copy action]]		[[File:ood_remote_copy_action.png\|rclone remote copy action]]

	This would trigger the file transfer to start. Once it was done, you would see the files available in the path that you requested them.		This would trigger the file transfer to start. Once it was done, you would see the files available in the path that you requested them.

	[[File:ood_remote_copy_finished.png\|rclone copy finished]]		[[File:ood_remote_copy_finished.png\|rclone copy finished]]
	==== Command Line ====		==== Command Line ====

Mozes at 17:06, 19 April 2023

2023-04-19T17:06:43Z

← Older revision		Revision as of 12:06, 19 April 2023
Line 166:		Line 166:
	</ol>		</ol>
	=== Transferring files ===		=== Transferring files ===
			==== OnDemand ====
			Once you have defined an endpoint, you can use that endpoint in the Files manager in OpenOnDemand.

			First you'd select the endpoint and files/folder you would like to copy or move. Then you would click the copy/move button near the top.
			[[File:ood_remote_copy_selection.png\|rclone copy file selection]]

			The you would traverse to the location where you would like to copy/move the files/folders to and then you would click the copy or move button on the left.
			[[File:ood_remote_copy_action.png\|rclone remote copy action]]

			This would trigger the file transfer to start. Once it was done, you would see the files available in the path that you requested them.
			[[File:ood_remote_copy_finished.png\|rclone copy finished]]
			==== Command Line ====
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone copy myOneDrive:/SomeFile.txt ./		[mozes@gremlin01 ~]$ rclone copy myOneDrive:/SomeFile.txt ./
Line 173:		Line 185:
	<li>To download directories, use the rclone copy command and use directory names over file. This copies the contents of the folders, so you need to specify a destination folder.</li>		<li>To download directories, use the rclone copy command and use directory names over file. This copies the contents of the folders, so you need to specify a destination folder.</li>
	</ol>		</ol>
	=== Download a directory from OneDrive ===		===== Download a directory from OneDrive =====
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone copy myOneDrive:/my_beocat_dir ./my_beocat_dir		[mozes@gremlin01 ~]$ rclone copy myOneDrive:/my_beocat_dir ./my_beocat_dir
Line 179:		Line 191:
	To upload a directory named my_beocat_dir to OneDrive, use rclone copy.		To upload a directory named my_beocat_dir to OneDrive, use rclone copy.

	=== Upload a directory to OneDrive ===		===== Upload a directory to OneDrive =====
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone copy ./my_beocat_dir myOneDrive:/my_beocat_dir		[mozes@gremlin01 ~]$ rclone copy ./my_beocat_dir myOneDrive:/my_beocat_dir
Line 186:		Line 198:
	<li>Rclone also supports using sync to transfer files, similar to rsync. The syntax is similar to rclone copy. This would only transfer files that are updated by name, checksum, or time. The example below would sync the files of the local directory to the remote directory on OneDrive.</li>		<li>Rclone also supports using sync to transfer files, similar to rsync. The syntax is similar to rclone copy. This would only transfer files that are updated by name, checksum, or time. The example below would sync the files of the local directory to the remote directory on OneDrive.</li>
	</ol>		</ol>
	=== Sync changed files ===		===== Sync changed files =====
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone sync ./my_beocat_dir myOneDrive:/my_beocat_dir		[mozes@gremlin01 ~]$ rclone sync ./my_beocat_dir myOneDrive:/my_beocat_dir
	</syntaxhighlight>		</syntaxhighlight>

			== Potential issues ==
			If you've setup an rclone remote previously and it no longer works, it may be that rclone's connection to your cloud storage has expired.

			You may need to follow the procedures to get a desktop ondemand session above, then reauthorize your connection:
			rclone config reconnect $whatever_you_named_your_endpoint:
			'''note the trailing :'''

Mozes at 19:35, 31 October 2022

2022-10-31T19:35:28Z

← Older revision		Revision as of 14:35, 31 October 2022
Line 9:		Line 9:
	</ol>		</ol>
	<ol start="2">		<ol start="2">
	<li>Open a browser on your local machine and navigate to the OnDemand portal for the cluster of your choice. We use Beocat for this example: https://ondemand.beocat.ksu~~.edu~~.edu. Select Desktop under Interactive Apps in the menu at the top of the page to get a virtual desktop on the cluster.</li>		<li>Open a browser on your local machine and navigate to the OnDemand portal for the cluster of your choice. We use Beocat for this example: https://ondemand.beocat.ksu.edu. Select Desktop under Interactive Apps in the menu at the top of the page to get a virtual desktop on the cluster.</li>
	</ol>		</ol>

Mozes at 19:27, 31 October 2022

2022-10-31T19:27:23Z

← Older revision		Revision as of 14:27, 31 October 2022
Line 3:		Line 3:
	Rclone is an open source file transfer tool to make transfering files to and from various cloud resources such as Box, Amazon S3, Microsoft OneDrive, and Google Cloud Storage and your local machine a simpler task. Guides on how to set up a variety of resources to transfer to and from can be found at [https://rclone.org/ rclone’s webpage].		Rclone is an open source file transfer tool to make transfering files to and from various cloud resources such as Box, Amazon S3, Microsoft OneDrive, and Google Cloud Storage and your local machine a simpler task. Guides on how to set up a variety of resources to transfer to and from can be found at [https://rclone.org/ rclone’s webpage].

	This tool can be used to transfer files between Beocat clusters and outside cloud providers, such as OneDrive.		This tool can be used to transfer files between Beocat clusters and outside cloud providers, such as OneDrive. This tool may allow you to perform backups of critical data onto remote systems.
	== Setup RClone ==		== Setup RClone ==
	<ol start="1">		<ol start="1">

Mozes at 18:44, 31 October 2022

2022-10-31T18:44:58Z

← Older revision		Revision as of 13:44, 31 October 2022
Line 25:		Line 25:
	<li>At the command prompt in the shell that opens, load the rclone module by entering the command below at the prompt:</li>		<li>At the command prompt in the shell that opens, load the rclone module by entering the command below at the prompt:</li>
	</ol>		</ol>
	Load the Rclone module		===Load the Rclone module===
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ module load rclone		[mozes@gremlin01 ~]$ module load rclone
Line 32:		Line 32:
	<li>We will need to start the basic configuration for OneDrive. To do this run rclone config:</li>		<li>We will need to start the basic configuration for OneDrive. To do this run rclone config:</li>
	</ol>		</ol>
	Load the rclone config		===Load the rclone config===
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone config		[mozes@gremlin01 ~]$ rclone config
Line 39:		Line 39:
	<li>In a new configuration, you will see no remotes found. Enter n to make a new remote and name it a name you will know. In our example, we will use “myOneDrive”. Select Microsoft OneDrive by entering in the corresponding number, in our case 27. Hit Enter for the client_id, client_secret, and Edit advanced config. When you are prompted for auto config, select n. The terminal will stop at a result> prompt. Proceed to the next step.</li>		<li>In a new configuration, you will see no remotes found. Enter n to make a new remote and name it a name you will know. In our example, we will use “myOneDrive”. Select Microsoft OneDrive by entering in the corresponding number, in our case 27. Hit Enter for the client_id, client_secret, and Edit advanced config. When you are prompted for auto config, select n. The terminal will stop at a result> prompt. Proceed to the next step.</li>
	</ol>		</ol>
	Configure OneDrive		===Configure OneDrive===
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone config		[mozes@gremlin01 ~]$ rclone config
Line 89:		Line 89:
	</ol>		</ol>
	In the new shell that opens, load the rclone module like you did in the first shell with module load rclone, and then run rclone authorize "onedrive" at the command prompt. You will be prompted to go to a 127.0.0.1 address in a web browser.		In the new shell that opens, load the rclone module like you did in the first shell with module load rclone, and then run rclone authorize "onedrive" at the command prompt. You will be prompted to go to a 127.0.0.1 address in a web browser.
	Authorize OneDrive from the terminal		===Authorize OneDrive from the terminal===
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ module load rclone		[mozes@gremlin01 ~]$ module load rclone
Line 109:		Line 109:
	Copy the text by highlighting it, right-clicking, and selecting copy. Then, return to the first terminal with the waiting result prompt and paste the text by right-clicking and selecting paste, then press enter. Next, select option 1 for OneDrive Personal or Business and then 1 for OneDrive (business). Press y at the next two prompts to confirm and q to exit.		Copy the text by highlighting it, right-clicking, and selecting copy. Then, return to the first terminal with the waiting result prompt and paste the text by right-clicking and selecting paste, then press enter. Next, select option 1 for OneDrive Personal or Business and then 1 for OneDrive (business). Press y at the next two prompts to confirm and q to exit.

	Authorize OnDemand on cluster		===Authorize OnDemand on cluster===
	<syntaxhighlight>		<syntaxhighlight>
	result> {"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"}		result> {"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"}
Line 158:		Line 158:
	Now test the connection by running the ls command. You should see a listing of your OneDrive files.		Now test the connection by running the ls command. You should see a listing of your OneDrive files.

	List contents of OneDrive		=== List contents of OneDrive ===
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone ls myOneDrive:/		[mozes@gremlin01 ~]$ rclone ls myOneDrive:/
Line 165:		Line 165:
	<li>To upload or download files, use the rclone copy command. For example:</li>		<li>To upload or download files, use the rclone copy command. For example:</li>
	</ol>		</ol>
	Transferring files		=== Transferring files ===
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone copy myOneDrive:/SomeFile.txt ./		[mozes@gremlin01 ~]$ rclone copy myOneDrive:/SomeFile.txt ./
Line 173:		Line 173:
	<li>To download directories, use the rclone copy command and use directory names over file. This copies the contents of the folders, so you need to specify a destination folder.</li>		<li>To download directories, use the rclone copy command and use directory names over file. This copies the contents of the folders, so you need to specify a destination folder.</li>
	</ol>		</ol>
	Download a directory from OneDrive		=== Download a directory from OneDrive ===
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone copy myOneDrive:/my_beocat_dir ./my_beocat_dir		[mozes@gremlin01 ~]$ rclone copy myOneDrive:/my_beocat_dir ./my_beocat_dir
Line 179:		Line 179:
	To upload a directory named my_beocat_dir to OneDrive, use rclone copy.		To upload a directory named my_beocat_dir to OneDrive, use rclone copy.

	Upload a directory to OneDrive		=== Upload a directory to OneDrive ===
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone copy ./my_beocat_dir myOneDrive:/my_beocat_dir		[mozes@gremlin01 ~]$ rclone copy ./my_beocat_dir myOneDrive:/my_beocat_dir
Line 186:		Line 186:
	<li>Rclone also supports using sync to transfer files, similar to rsync. The syntax is similar to rclone copy. This would only transfer files that are updated by name, checksum, or time. The example below would sync the files of the local directory to the remote directory on OneDrive.</li>		<li>Rclone also supports using sync to transfer files, similar to rsync. The syntax is similar to rclone copy. This would only transfer files that are updated by name, checksum, or time. The example below would sync the files of the local directory to the remote directory on OneDrive.</li>
	</ol>		</ol>
	~~transfer.sh~~		=== Sync changed files ===
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@gremlin01 ~]$ rclone sync ./my_beocat_dir myOneDrive:/my_beocat_dir		[mozes@gremlin01 ~]$ rclone sync ./my_beocat_dir myOneDrive:/my_beocat_dir
	</syntaxhighlight>		</syntaxhighlight>

Mozes at 18:37, 31 October 2022

2022-10-31T18:37:48Z

← Older revision		Revision as of 13:37, 31 October 2022
Line 11:		Line 11:
	<li>Open a browser on your local machine and navigate to the OnDemand portal for the cluster of your choice. We use Beocat for this example: https://ondemand.beocat.ksu.edu.edu. Select Desktop under Interactive Apps in the menu at the top of the page to get a virtual desktop on the cluster.</li>		<li>Open a browser on your local machine and navigate to the OnDemand portal for the cluster of your choice. We use Beocat for this example: https://ondemand.beocat.ksu.edu.edu. Select Desktop under Interactive Apps in the menu at the top of the page to get a virtual desktop on the cluster.</li>
	</ol>		</ol>

			[[File:ood_rclone_desktop_selection.png\|select desktop]]

	Scroll down to the bottom of the next page, and click on the blue Launch button. When the resource is ready, click on the blue Launch Desktop button that appears on the next page.		Scroll down to the bottom of the next page, and click on the blue Launch button. When the resource is ready, click on the blue Launch Desktop button that appears on the next page.

			[[File:ood_rclone_desktop_launch.png\|launch desktop]]

	On the virtual desktop, click on the Terminal Emulator icon at the bottom of the window to open up a command shell.		On the virtual desktop, click on the Terminal Emulator icon at the bottom of the window to open up a command shell.

			[[File:ood_rclone_terminal_launch.png\|launch terminal]]

	<ol start="3">		<ol start="3">
	<li>At the command prompt in the shell that opens, load the rclone module by entering the command below at the prompt:</li>		<li>At the command prompt in the shell that opens, load the rclone module by entering the command below at the prompt:</li>
Line 96:		Line 104:

	Return to the terminal window where you ran the authorize command. You should see a message instructing you to paste a line of code into your “remote machine” which is the first terminal you opened to run rclone config.		Return to the terminal window where you ran the authorize command. You should see a message instructing you to paste a line of code into your “remote machine” which is the first terminal you opened to run rclone config.

			[[File:ood_rclone_token.png\|rclone token]]

	Copy the text by highlighting it, right-clicking, and selecting copy. Then, return to the first terminal with the waiting result prompt and paste the text by right-clicking and selecting paste, then press enter. Next, select option 1 for OneDrive Personal or Business and then 1 for OneDrive (business). Press y at the next two prompts to confirm and q to exit.		Copy the text by highlighting it, right-clicking, and selecting copy. Then, return to the first terminal with the waiting result prompt and paste the text by right-clicking and selecting paste, then press enter. Next, select option 1 for OneDrive Personal or Business and then 1 for OneDrive (business). Press y at the next two prompts to confirm and q to exit.

Mozes at 18:33, 31 October 2022

2022-10-31T18:33:31Z

← Older revision		Revision as of 13:33, 31 October 2022
Line 19:		Line 19:
	Load the Rclone module		Load the Rclone module
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@~~mole080~~ ~]$ module load rclone		[mozes@gremlin01 ~]$ module load rclone
	</syntaxhighlight>		</syntaxhighlight>
	<ol start="4">		<ol start="4">
Line 26:		Line 26:
	Load the rclone config		Load the rclone config
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@~~mole080~~ ~]$ rclone config		[mozes@gremlin01 ~]$ rclone config
	</syntaxhighlight>		</syntaxhighlight>
	<ol start="5">		<ol start="5">
	<li>In a new configuration, you will see no remotes found. Enter n to make a new remote and name it a name you will know. In our example, we will use “myOneDrive”. Select Microsoft OneDrive by entering in the corresponding number, in our case 32. Hit Enter for the client_id, client_secret, and Edit advanced config. When you are prompted for auto config, select n. The terminal will stop at a result> prompt. Proceed to the next step.</li>		<li>In a new configuration, you will see no remotes found. Enter n to make a new remote and name it a name you will know. In our example, we will use “myOneDrive”. Select Microsoft OneDrive by entering in the corresponding number, in our case 27. Hit Enter for the client_id, client_secret, and Edit advanced config. When you are prompted for auto config, select n. The terminal will stop at a result> prompt. Proceed to the next step.</li>
	</ol>		</ol>
	Configure OneDrive		Configure OneDrive
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@~~mole080~~ ~]$ rclone config		[mozes@gremlin01 ~]$ rclone config
	No remotes found - make a new one		No remotes found - make a new one
	n) New remote		n) New remote
Line 43:		Line 43:
	Enter a string value. Press Enter for the default ("").		Enter a string value. Press Enter for the default ("").
	Choose a number from below, or type in your own value		Choose a number from below, or type in your own value
	32 / Microsoft OneDrive		27 / Microsoft OneDrive
	\ "onedrive"		\ "onedrive"
	Storage> 32		Storage> 27
	See help for onedrive backend at: https://rclone.org/onedrive/		See help for onedrive backend at: https://rclone.org/onedrive/
	Microsoft App Client Id		Microsoft App Client Id
Line 55:		Line 55:
	Enter a string value. Press Enter for the default ("").		Enter a string value. Press Enter for the default ("").
	client_secret>		client_secret>
			Option region
			Choose national cloud region for OneDrive.
			Enter a string value. Press Enter for the default ("global").
			Choose a number from below, or type in your own value.
			region> 1
	Edit advanced config? (y/n)		Edit advanced config? (y/n)
	y) Yes		y) Yes
Line 78:		Line 83:
	Authorize OneDrive from the terminal		Authorize OneDrive from the terminal
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@~~mole080~~ ~]$ module load rclone		[mozes@gremlin01 ~]$ module load rclone
	[mozes@~~mole080~~ ~]$ rclone authorize "onedrive"		[mozes@gremlin01 ~]$ rclone authorize "onedrive"
	If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth		If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth
	Log in and authorize Rclone for access		Log in and authorize Rclone for access
Line 112:		Line 117:
	1: OneDrive (business) id=b!laCd4ZJ54U-[...]		1: OneDrive (business) id=b!laCd4ZJ54U-[...]
	Chose drive to use:> 1		Chose drive to use:> 1
	Found drive 'root' of type 'business', URL:		Found drive 'root' of type 'business', URL: https://ksuemailprod-my.sharepoint.com/personal/mozes_ksu_edu/Documents
	Is that okay?		Is that okay?
	y) Yes (default)		y) Yes (default)
Line 145:		Line 150:
	List contents of OneDrive		List contents of OneDrive
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@~~mole080~~ ~]$ rclone ls myOneDrive:/		[mozes@gremlin01 ~]$ rclone ls myOneDrive:/
	</syntaxhighlight>		</syntaxhighlight>
	<ol start="7">		<ol start="7">
Line 152:		Line 157:
	Transferring files		Transferring files
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@~~mole080~~ ~]$ rclone copy myOneDrive:/SomeFile.txt ./		[mozes@gremlin01 ~]$ rclone copy myOneDrive:/SomeFile.txt ./
	[mozes@~~mole080~~ ~]$ rclone copy ./SomeFile.txt myOneDrive:/		[mozes@gremlin01 ~]$ rclone copy ./SomeFile.txt myOneDrive:/
	</syntaxhighlight>		</syntaxhighlight>
	<ol start="8">		<ol start="8">
Line 160:		Line 165:
	Download a directory from OneDrive		Download a directory from OneDrive
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@~~mole080~~ ~]$ rclone copy myOneDrive:/my_beocat_dir ./my_beocat_dir		[mozes@gremlin01 ~]$ rclone copy myOneDrive:/my_beocat_dir ./my_beocat_dir
	</syntaxhighlight>		</syntaxhighlight>
	To upload a directory named my_beocat_dir to OneDrive, use rclone copy.		To upload a directory named my_beocat_dir to OneDrive, use rclone copy.
Line 166:		Line 171:
	Upload a directory to OneDrive		Upload a directory to OneDrive
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@~~mole080~~ ~]$ rclone copy ./my_beocat_dir myOneDrive:/my_beocat_dir		[mozes@gremlin01 ~]$ rclone copy ./my_beocat_dir myOneDrive:/my_beocat_dir
	</syntaxhighlight>		</syntaxhighlight>
	<ol start="9">		<ol start="9">
Line 173:		Line 178:
	transfer.sh		transfer.sh
	<syntaxhighlight>		<syntaxhighlight>
	[mozes@~~mole080~~ ~]$ rclone sync ./my_beocat_dir myOneDrive:/my_beocat_dir		[mozes@gremlin01 ~]$ rclone sync ./my_beocat_dir myOneDrive:/my_beocat_dir
	</syntaxhighlight>		</syntaxhighlight>

Mozes at 18:10, 31 October 2022

2022-10-31T18:10:34Z

← Older revision		Revision as of 13:10, 31 October 2022
Line 88:		Line 88:
	<---End paste		<---End paste
	</syntaxhighlight>		</syntaxhighlight>
	Right-click on the link and select open link from the menu. A browser window will open on the virtual desktop. On the Microsoft Office sign-in page that opens enter in your NU e-mail address and click “Next”. You will be taken to your eID single sign-on page where you can sign in using your KSU eID credentials. If login is successful, you should be redirected to a page that says “Success!”		Right-click on the link and select open link from the menu. A browser window will open on the virtual desktop. On the Microsoft Office sign-in page that opens enter in your KSU e-mail address and click “Next”. You will be taken to your eID single sign-on page where you can sign in using your KSU eID credentials. If login is successful, you should be redirected to a page that says “Success!”

	Return to the terminal window where you ran the authorize command. You should see a message instructing you to paste a line of code into your “remote machine” which is the first terminal you opened to run rclone config.		Return to the terminal window where you ran the authorize command. You should see a message instructing you to paste a line of code into your “remote machine” which is the first terminal you opened to run rclone config.