Alteryx Engine and AMP: Main Differences

Version:
Current
Last modified: September 14, 2020

In the first article we have covered what is the Alteryx Engine and the new Alteryx Multi-threaded Processing (AMP). Now let’s go deeper into the main differences between the two.

Data Processing Differences

The original engine architecture allows for mostly single-threaded processing, where your data are processed record-by-record sequentially. On the other hand, the new AMP concept allows for massively multi-threaded processing. Records process in 4 Mb packets for a faster run time, and in parallel, which can affect the output record order.

With multiple cores, the AMP architecture allows for multi-threaded processing.

The original engine architecture allows for a single-threaded process, where your data is processed record-by-record.

Output Differences

Several tools might output records in a different order than the original engine when running a workflow with the AMP engine. Some of those tools include the following:

  • Cross Tab
  • Dynamic Input
  • Join
  • Join Multiple
  • Poly Build
  • Running Total
  • Tile
  • Union
  • Unique

Specific functionality or configuration that has not been converted to AMP reverts to the original engine tool to work. Therefore workflows that contain both AMP-converted and non-converted tools will run seamlessly with AMP.

If you have questions as to which tools might have been converted to AMP, see: Tool Use with AMP.

Read Performance

A .yxdb file written with the AMP engine will read in faster than a .yxdb written with the original engine.

The .yxdb file written with the original engine will be read slower with AMP enabled. The formats are still compatible with each other. With AMP, you can also go to the Output Data - Configuration menu where you have an option to create the version of YXDB file compatible with Designer 18.1 and older.
Use .csv and .yxdb files with AMP - they both support multi-threaded, read in data.

When opened in a text editor, a yxdb file written with AMP have "Alteryx e2 Database file" at the very beginning of the file content. A file written with the original Engine will just show "Alteryx Database File" at the same place.

Performance Profiling

Performance Profiling per tool is on the roadmap for inclusion in a future release, but not yet available with AMP.

Text Input Tool and Auto Field

AMP addresses a historic issue where the size of the field may not be large enough when processed by a downstream tool. You don't need to add Select tools to change data types when resulting data will exceed the length of the original data type. AMP  creates the maximum size field for strings and integers so that subsequent operations will have the necessary room to hold larger downstream values.

Throttle Tool

Although the Throttle tool was not fully converted to AMP, you can use it together with the Download tool (Throttle first).

Fuzzy Match

Fuzzy Match may have different results between the original engine and AMP. AMP records are matched using an alternative method. The order of match might be different and the output may be in reverse order as well.

RegEx Tool

AMP uses Unicode and Perl encoding standards, where characters $+<=>^|~ do not qualify as punctuation. When using the formula function REGEX_Replace or the REGEX tool to filter punctuation using the RegEx set [[:punct:]], with AMP you need to change the expression, for example:REGEX_REPLACE([_CurrentField_],'[[:punct:]]|[\$\+<=>\^`\|~]','')

Grouping Tools - Blocking Tools

The Join algorithm with the original engine is based on sort-merge join method, where the records always come in a sorted order. The new Join algorithm with AMP is based on a hash join method, so the record order comes out disordered.
For example:
The Join algorithm with AMP is based on hash join, so the record order is different.

Left input:
The Join algorithm - left input.

Right input:
The Join algorithm - right input.

If we join by CustomerID with the original Engine, records order will be sorted by CustomerID field:
Join by CustomerID with the original Engine.

While with AMP, records will be the same but in a different order:
Join by CustomerID with AMP.

If you need to have sorted order in join output, add the Sort tool after Join.

Iterative Macros

The difference between the original Engine and AMP can occur when a tool inside the macro reports an error. Being single-threaded, the original Engine stops if an error occurs in the macro. AMP works until the iterative output is empty or the maximum number of iterations occur.
You can encounter following situations, due to higher number of iterations:

  • The number of errors (if any) can be higher with AMP.
  • The number of records could be higher with AMP.
  • The output schema could be different with AMP.

Formula Add-Ins

Formula Add-Ins are not yet supported with AMP. If you need to run a workflow containing Formula Add-In functionality, run it using the original engine. 

Analytic App 

Apps using the Map tool to select from a spatial reference layer in an Analytic App should continue using original engine.

Expect Equal 

With the original engine, Expect Equal remains a CReW macro. With AMP it runs as a Native Tool.

Parallel Branch Execution and the Tool Run Order

Some workflows read from a file and then write back to it. This requires sequencing to ensure that the read is complete before the write can start. Similarly, a workflow that wants to write several sheets in one .xlsx file needs to write the sheets one at a time. Alteryx Designer provides a Block Until Done (BUD) tool to help partition the work into phases that won’t get in each other’s way.

When working on a workflow with multiple branches (largely separate streams from inputs to outputs), place the BUD tool in the workflow branch with the lowest numbered Input tool ID. This ensures every subsequent branch waits to run until the previous branch is done and the tool works as expected.

Available Functionality

For more information regarding specific tool functionality, see: Tool Use with AMP.

Was This Helpful?

Running into problems or issues with your Alteryx product? Visit the Alteryx Community or contact support.