File Format Options
Depending on the file format or database connection you use to input or output data, configuration options vary. Select file format options in the following tools: Input Data Tool, Output Data Tool, Connect In-DB Tool, Data Stream In Tool, Write Data In-DB Tool.
Option | Description | Formats |
---|---|---|
Allow Extraction of Files >2GB | Select to allow Alteryx to extract a file greater than 2 GB. See Zip File Support and Gzip File Support. | .zip, *.gz, *.tgz |
Allow Shared Write Access | Select to read an open file that may be in the process of being updated. This option is intended for reading web logs. | |
Append to Existing Table | Select to append records to an existing table. | .dbase, .sdf |
Append Field Map | Select to append fields and set how output fields will map to the fields in the OleDB table. | .mdb, .xls, .accdb, ODBC, OLEDB |
Code Page | Select a code page for converting text in input or output data. See Code Pages. | .csv, .dbf, .flat, .json, .mid, .mif, .tab, .shp |
Create Int32 Fields as Binary |
Select to create all Int32 fields as 32 bit (4 byte) binary values in the database instead of the default 11 character text format.
This option is not supported by all DBF readers. |
.dbase |
Delimiter |
Select the field delimiter in the data.
Use \0 to read or write a text file with no delimiter. Use 0 if the data contains two or more delimiters to force Designer to read the data as flat text. Use the RegEx Tool in Tokenize mode to parse your data. |
.csv, .txt |
Description or Data File | Define the file name of a .flat file used as a layout file. | .flat |
Do not show % Complete | Select to disable a status report of file read-in progress; this speeds up read time. | |
Enable Compression (Deflate) |
Select to output a compressed .avro file.
The deflate algorithm (similar to gzip) is used and should be supported by other Avro-capable tools such as Hive. Compression increases output time, but with larger files, will reduce network time. |
.avro |
Expand Value Labels |
Read and apply value labels (key) to data. This option is selected by default for SPSS and SAS files. See Stat Transfer Supported File Formats.
If not selected, only the value key is displayed. |
.spss, .sas |
Field Length | Define the maximum field length in the input data. | |
File Format | Select the data file format. | all formats |
File in Archive | Change the file (or files) to input. See Zip File Support. | .zip |
First Row Contains Data | Select if the first row should be treated as data, not a header. | .xlsx |
First Row Contains Field Names | Select if the first row should be treated as a header. | .csv |
Force SQL WChar Support | Select to allow character columns to be treated as SQL_WCHAR, SQL_WVARCHAR, or SQL_WLONGVARCHAR. | .oci, unicode.txt |
If Long Lines are Allowed | Use the selected .flat file (default), or override the setting. | .flat |
If Short Lines are Allowed | Use the selected .flat file (default), or override the setting. | .flat |
Ignore Delimiters in |
Select an option:
Quotes: Ignore delimiters in quotes. Single Quotes: Ignore delimiters in single quotes. Auto: Ignore auto-detected delimiters. None: Do not ignore delimiters. |
|
Ignore XML Errors and Continue | Ignore incorrect XML formatting and continue running the workflow. See Reading XML. | .xml |
Line Ending Style | Define the character or sequence of characters signifying the end of a line of text. | .csv, .flat |
Max Records Per File | Define the number of records to output to a single file. If the data contains more records, multiple files are created and named sequentially. | all formats |
No Spatial Index |
Select to turn off the spatial index.
Use this option only when writing large temporary files that will not be used in spatial operations. This option writes smaller files and faster. |
.yxdb |
Output all Fields as Strings | Select to convert incoming fields to string data type; this bypasses conversion errors if the data type is wrong in .dbf files. | .dbf |
Output File Name as Field | Select to append a field with the file name or file path to each record. | |
Output Options |
Select an output option:
Create New Sheet: creates a new sheet, but does not overwrite an existing sheet Append to Existing Sheet: appends data to an existing sheet so that the output consists of new and previous data Overwrite Sheet (Drop): deletes the selected sheet and writes data into a new sheet with the selected name Overwrite File (Remove): deletes the existing file and creates a new file |
.xlsx, .xlsm (via Alteryx .xlsx driver) |
Output Options |
Select an output option:
Create New Table: creates a new table, but does not overwrite an existing table Append Existing: appends data to an existing table so that the output consists of Records Before plus Records After Delete Data and Append: deletes all original records from the table and appends data to the existing table Overwrite Table (Drop): drops the existing table and creates a new table |
.accdb, .mdb, .tde, .xls, .xlsx (via the legacy .xlsx driver), .oci, OLEDB, ODBC |
Output Options |
Select an option:
Update, warn on failure updates existing records using the output and warns if a record could not be updated Update, error on failure: updates existing records using the output and stops processing if a record could not be updated Update, insert if new: updates existing records using the output and inserts new records if they were not in the database table and stops processing if a record could not be updated If there are multiple records with the same primary key and no other SQL errors occur, the new record updates the older record in the database. Use the Unique Tool to check for multiple primary keys prior to writing to the database. |
.oci, OLEDB, ODBC |
Overwrite Existing Table | Selected by default, this option overwrite an existing file type of the same name. | .mdb* |
Parse Selected File as | Change the format in which to parse the file. | .zip |
Parse Value as String | Select to parse output data as a string; if not selected, data is parsed based on data type. | |
Passwords | Select how a password will display in the Configuration window: Hide (default), Encrypt for Machine, Encrypt for User. | |
Pre Create SQL* Statement | Define an SQL statement to execute via the ODBC/OLEDB driver before the output table is created. | .mdb, .mdb*, .oci, .accdb, ODBC, OLEDB |
Post Create SQL* Statement | Define an SQL statement to execute via the ODBC/OLEDB driver after the output table is created. | .mdb, .mdb*, .oci, .accdb, ODBC, OLEDB |
Projection | Define the output project. By default, Projection is blank and outputs to WGS 84. See Projection Support. | .mid, .mif, .tab, .shp, .oci, .mdb |
Quote Output Field |
Choose an option for quoting output fields:
Auto: inserts quotes around fields that have a single or double quote, and around fields that contain delimeters Always: inserts quotes around each field Never: does not insert quotes |
|
Read Spatial Objects as Centroids | For data with polygon objects, select to use the polygon's centroid as the spatial object. | .mdb*, .tab, .oci, .sdf, .shp, .geo, .kml, .mid, .mif |
Record Limit | Select to limit the records read from input data. If 0, all records are returned. If -1, only the metadata is returned. | |
Return Child Values | Selected by default to output the child values of the root element or a specified XML Child Element Name. See Reading XML. | .xml |
Return Outer XML | Select to output the format of the XML tag of a specified XML Child Element Name. Deselect to output the format of the root element's children. See Reading XML. | .xml |
Return Root Element | Select to output the parent element that encloses all other elements. See Reading XML. | .xml |
Run PreSQL on tool configuration |
Selected by default, this option runs preSQL statements when a tool is brought into a workflow.
Deselect the check box to run preSQL statements when the workflow is executed instead. |
|
Save Source and Description | Selected by default, this option includes source and description data in the metainfo. Deselect the option to exclude source and description data. | |
Search SubDirs | Use to bring in multiple inputs if data files are in a sub-directory and contain the same structure, field names, length, and data types. | |
Size of Bulk Load Chunks (1 MB to 102400 MB) | The size of bulk load chunks to write. The default setting is 128 MB. |
|
Skip Field Names | When checked, this option allows you to write data only in a sheet or a range. | .xlsx, .xlsm |
Spatial Object Field |
Define the spatial object to include in the output. Spatial files can only contain one spatial object per record.
Alteryx does not support reading or writing multiple geometry types in a single file. |
.mdb*, .tab, .oci, .sdf, .shp, .geo, .kml, .mid, .mif |
Show Transaction Message | Select to display, in the Results window, a message for each transaction. Each message reports the sum of records written up to that transaction. | |
Start Data Import on Line | Define a line number on which to start reading data. By default, it begins on Line 1. | .csv, .xlsx |
Support Null Values |
Select to output an .avro file with Null values.
This output option unions fields with a null branch and a value branch. If the Alteryx value is Null, the output will use the null branch; otherwise, the value branch is used. If this option is not selected, all output fields will write as their native .avro types (non-union). Alteryx fields that are Null are written as their default value. Use the Formula Tool to handle Null values with 'known' values so that the values can be read in Hadoop. |
.avro |
Table Type |
Use to select system default, column, or row table stores.
The table stores represent how the data is stored. The system default honors the table store of the underlying database. You will notice a decline in performance when you create a column store table versus a row store table. |
SAP Hana ODBC |
Table/Field Name SQL Style | Select Quoted or None. Quoted uses the Quote Identifier for the database type. | .oci, OLEDB, OBDC, |
Table or Query | If data contains multiple tables, define the table to input, or click to create a query. See Choose Table or Specify Query Window. | |
Take File Name From Field |
Select an option to write a separate file for each value of a particular field:
Append Suffix to File/Table Name: appends selected field name to the end of the table name Prepend Prefix to File/Table Name: prepends selected field name to beginning of the table name Change File Name: changes the file name to the select field name Change Entire File Path: changes the file name to the selected field name that contains a full path |
all output formats |
Transaction Size |
Define the number of records at a time to write to a database.
By default, transaction size is 10000, meaning all records. Set records to at least 1000 because the database creates a temporary log file for each transaction which could quickly fill up temporary space. |
.oci, OLEDB, ODBC |
Treat Errors as Warnings | Select to input data with records that do not conform to the data structure. Typically errors cause the input to fail; this option prevents input failure by treating errors as warnings. | |
Trim White Space | Use the selected .flat file (default), or override the setting. | .flat |
What Kind of Line Ends to Use | Use the selected .flat file (default), or override the setting. | .flat |
Write BOM | Select to include the byte order mark (BOM) in the output, or deselect to output without a byte order mark. | .csv |