Dropbox ETL connector for data replication

Snapshot

Pre-requisites

1. Users must have an active Dropbox account
2. Ensure that there is at least one file in the required format at the storage location and it has at least 1000 records with valid data. Daton uses this file as sample for generating the schema automatically
3. Daton supports only the following DateTime formats. Dates will be processed as Strings if the format is not in the below listed formats 
   YYYY-MM-DD HH:MM:SS
4. Each folder must have files in the same format. If files with either a different file format or different file type are present then data extracts will throw exceptions and data would not be processed. Create separate integrations for different file types and file formats

Integrate Dropbox with Daton

1. Sign-in to Daton 
2. Select Dropbox from the list of Integrations 
3. Provide Integration Name, and Replication Frequency. Integration name would be used in creating tables for the integration and cannot be changed later 
4. Authenticate with your Dropbox username and password
5. Provide the following details for the integration - 
   File Path: /folder/sub-folder Eg. /Data/DailyEvents in https://www.dropbox.com/home/Data/DailyEvents
   File Type: We presently support only CSV format
   Number of Header Rows: We do not support nested headers 
6. Review and update column names and datatypes from the auto generated schema mapper
7. Submit the integration

Workflow

1. Integrations would be in Pending state initially and will be moved to Active state as soon as the first job loads data successfully on to the configured warehouse
2. Users would be able to edit/pause/re-activate/delete integration anytime
3. Users can view job status and process logs from the integration details page by clicking on the integration name from the active list
4. Files to be processed would be identified with the modified dates of files. If a few records in an existing file get updated, then entire file would be processed again
5. Files present in sub folders from the selected location would not be processed
6. If new fields are to be added to the files, users must append them to the file, and edit the existing integration in Daton by appending the additional fields for the integration. Daton doesn't support intermittent field additions to a file.

Error Handling

1. If Date format used in files do not fall in the above mentioned list, then they would be processed as strings
2. Datatypes cannot be changed after initiating the integration