gs_data_dir
Google storage bucket path that syncs to local storage when not running on CloudML.
Description
Refer to data within a Google Storage bucket. When running on CloudML the bucket will be read from directly. Otherwise, the bucket will be automatically synchronized to a local directory.
Usage
gs_data_dir(url, local_dir = "gs", force_sync = FALSE, echo = TRUE) Arguments
| Arguments | Description |
|---|---|
| url | Google Storage bucket URL (e.g. gs://<your-bucket>). |
| local_dir | Local directory to synchonize Google Storage bucket(s) to. |
| force_sync | Force local synchonization even if the data directory already exists. |
| echo | Echo command output to console. |
Details
This function is suitable for use in TensorFlow APIs that accept gs:// URLs (e.g. TensorFlow datasets). However, many package functions accept only local filesystem paths as input (rather than gs:// URLs). For these cases you can the gs_data_dir_local() function, which will always synchronize gs:// buckets to the local filesystem and provide a local path interface to their contents.
Value
Path to contents of data directory.
See Also
gs_data_dir_local()