Importing Data into the Database

It is possible to upload data to the database using Query Analyzer. This function is available from the Tools menu.

Workbench supports import of source files in the following formats:

Files in all the supported formats can be imported directly from an archive (zip, gzip, bzip2) without creating any intermediate disk file that may be quite large. Multiple CSV files can be imported at a time.

Currently, import from external databases is limited to uploading data only from another dashDB database.

Import Data from an External Database

Data import from another database involves generating DDL for the source tables and creating the tables from the DDL to hold the data.

Currently, only import from another dashDB database or an IBM PureData Systems for Analytics (Netezza) database is supported.

Importing data into an table that exists in a target dashDB database is not currently supported.

To import data from an external database:

  1. On the Tools menu, point to Import and then click from External Database.
  2. In the Database Type dialog box, select a database type.
  3. In the Connect to IBM PureData Systems for Analytics dialog box, in the Saved list, select a connection entry.

    A connection entry stores the information that is necessary for connecting to a database. The Saved list displays all previously created connection strings. If no connection strings were created, you need to create one. Click New, type the name for a connection entry, specify appropriate connection information in the Connect to IBM PureData Systems for Analytics dialog box, and click Save. To connect to a Netezza database, you must have an ODBC or OleDb driver installed on your system. In the Driver list, select a driver.

    ClosedHow to get an ODBC or OleDb driver

    Use the IBM Fix Central web site (http://www-933.ibm.com/support/fixcentral) for finding and downloading the IBM Netezza drivers that are suitable for your processor architecture (32-bit or 64-bit). Also, note that each IBM client accessing the Fix Central is required to have an individual IBM ID.

    The connection information from the connection entry is put into the Connect to IBM PureData Systems for Analytics dialog box.

    ClosedOptions in the Connect to IBM PureData Systems for Analytics dialog box

  4. Click OK to connect to the database.
  5. On the Data Transfer Wizard (step 1 of 3) page, select the tables in the database from which you want to import data.

    You can apply a filter to select or unselect tables according to appropriate conditions. Click to define a filter that selects tables or click to define a filter that unselects tables.

  6. On the Data Transfer Wizard (step 2 of 3) page, select the appropriate options to generate DDL for the selected source tables.

    In the Char case list, select a case option to apply to column names in the generated DDL.

    Aginity Workbench begins analyzing the selected tables against the target database. If any issues are encountered, the Data Transfer Wizard (step 3 of 3) page displays warnings. Review the warnings and take appropriate action if necessary.

  7. Click Finish to generate the DDL for the table.
  8. In the Data Transfer Options window, select appropriate options.
  9. Click OK to start importing the data.

    The Workbench Job Monitor shows the progress of the import. When the import is complete, the Status column displays "Number out of number objects transferred successfully."

    If the data import takes longer than the specified Default query time-out value (set in the application options), the import will time out with an error. If you want to import a large amount of data, consider setting a larger Default query time-out value.

    The tables that contain the imported data are displayed in the Object Browser.

    If the tables are not visible in the Object Browser, refresh it. Right-click the schema into which you imported the data and click Refresh Schema Objects on the shortcut menu.

Import Data into a Destination Database

To import data from a local file:

  1. On the Tools menu, point to Import and then click the command for the source file format (for example, from Excel).
  2. If you want to import an Excel file, browse to and select the file and then select the worksheet in the Excel file.

    The Data Import Wizard opens.

  3. If you are importing a JSON/XML file, select the nodes that will be turned into a flattened table during import.
  4. Select a file encoding and a field delimiter (applicable to a CSV or text file only), or the column widths and file encoding (applicable to a fixed column widths file only).
  5. Specify the range of data to import by setting the Start Column, Start Row, and End Row. If you don't want to import all the rows, clear the Import all rows check box and specify the End Row.

    During import of a CSV or text file, Workbench analyzes the data types in the file and makes necessary changes: it adjusts the length of some or all of the columns to the maximum length of the column's data type or changes the data type of columns. By default Workbench analyzes a maximum of 1,000 rows. If the file you are importing contains more than 1,000 rows, the Data Import Wizard displays a message that only 1,000 rows were analyzed. You can select the Analyze more option later in the wizard to have Workbench analyze all the rows in the file.

  6. Specify whether the first row in the source file contains the column names to be used in the destination table. Ensure that the Include Columns box lists only the columns that you want to import. Use the less than button to remove columns from the Include Columns box and the greater than button to add columns.
    • You can specify the order of columns in the target table by using the Up and Down buttons in the Include Columns box.
    • The column that is currently selected in the Include Columns box is highlighted in the Data Preview box.
  7. Specify data types, precision, length, and scale for the columns. Leave the default values that Aginity Workbench has determined to be valid syntax for the source data, or change the values. Select the check box in the Null column if the column can contain null values.

    A negative value of Scale means that scale is not applicable to the column.

  8. Select a destination database and a schema in the database, and type a name for the table to hold the imported data. Under Existing Table Action, select an action to take if the specified table exists in the destination database. Select Ignore empty lines (all NULLS) if you don't want to import the empty lines or rows in the source file.
  9. Click Finish.

    The Job Monitor displays the progress of a job for the file import. When the import is complete, the Status description column displays a corresponding status.

    If you have selected the Existing Table Action of Do Not Import and the specified destination table exists in the database, the Job Monitor displays an error message.

    If you chose to import the data into a new table, the table is displayed within the specified schema node in the Object Browser.

    You may need to refresh the Object Browser for the table to be displayed.


Aginity Workbench for dashDB * Topic last updated August 30, 2018