File upload
Last updated
Last updated
File upload API allows to put files into Data Lake by 2 sync mode:
Full sync: old sync data will be moved to trash
Incremental sync: data is gradually sync
File upload flows:
Start sync with api_key to get sync_id for this sync
Upload files, can be uploaded multiple times with the same sync_id
End sync
Method: POST
Path:
https://[client].datainsider.co/api/ingestion/file/sync/start
Parameter | Type | Description |
---|---|---|
Sample request:
Sample response:
Method: POST
Path:
https://[client].datainsider.co/api/lake/file/upload?path={path}&sync_id={sync_id}
Sample request:
Sample response:
Method: POST
Path:
https://[client].datainsider.co/api/ingestion/file/sync/end
Sample request:
Sample response:
Method: GET
Path:
https://[client].datainsider.co/api/ingestion/file/sync/list?from=0&size=10
Sample request:
Sample response:
Note: sync_status
field is enum with values: Syncing, Failed, Finished
Method: GET
Path:
https://[client].datainsider.co/api/ingestion/file/sync/history?from=0&size=10
Sample request:
Sample response:
Parameter | Type | Description |
---|---|---|
name
string
name of the sync
path
string
file storage path on data lake
api_key
string
API key
sync_type
enum
Full Sync | Incremental Sync
path
string
file storage path on data lake
sync_id
string
sync_id value that is taken from api start sync