Load (aka LoadTableFromSource)

Load operation copies (or moves) a table from one source to another.

Parameters:

• Target source options: allows to pass source-specific parameters to the target connection. Currently the following sources accept source-specific parameters:

  • AWSS3Source: you can pass Canned ACL list in the following JSON format: {"cannedAcl": ["BucketOwnerFullControl"]}. The permissions will be applied to the target file loaded to S3. You can list several permissions in the list. Here is a full list of permissions: AuthenticatedRead, AwsExecRead, BucketOwnerFullControl, BucketOwnerRead, LogDeliveryWrite, Private, PublicRead, PublicReadWrite.

• convert column names: converts column names of the target table. It is useful to make the target table easily addressed in queries. For example, if you load data into an Oracle database, you might want to convert column names to upper case so that you can use column names in SQL without quoting them. For more examples on column name conversion for different databases read DATABASE IDENTIFIERS, QUOTING AND CASE SENSITIVITY . The following conversion functions are supported:

  • standardize: normalize column names by converting to lower case and replacing spaces and punctuation with _
  • toUpperCase: convert column names to upper case
  • toLowerCase: convert column names to lower case

• drop the source table on completion (aka move): used to move (instead of copy) a table. If checked, the source table will be dropped after it is loaded to the target.

• do not drop target table before creating it: check this option if you don’t want to drop the target table (which is default behavior of many operations including Load) before starting the operation. For example, you can use this option if you don’t have permission to drop tables in the source but only create tables.

• add record order column: il_rec_num column of text type will be added to the result. The column will contain an auto-generated number of the record starting from 0. The number only make sense for sources that support order of records (e.g. CSV files).

• append to the target table: if checked, the target table will not be dropped at the beginning but the records of the source table will be inserted into the target table.